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Abstract 

We will focus on estimating the integrated covariance of two diffusion processes observed in a nonsynchronous 
manner. The observation data is contaminated by some noise, which is possibly correlated with the returns of the 
diffusion processes, while the sampling times also possibly depend on the observed processes. In a high-frequency 
setting, we consider a modified version of the pre-averaged Hayashi-Yoshida estimator, and we show that such 
I a kind of estimators has the consistency and the asymptotic mixed normality, and attains the optimal rate of 

convergence. 
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1 Introduction 



In financial econometrics, measuring the covariation of two assets is the central problem because it serves as a 
basis for many areas of finance, such as risk management, portfolio allocation and hedging strategies. In recent years 
there has been a considerable development of the statistical approaches to this problem using high frequency data. 
^ ■ Such approaches were pioneered by Andersen and BoUerslev [2] and Barndorff-Nielsen and Shephard [5] , and their 
methods are based on the semimartingale theory. In fact, no-arbitrage based characterizations of asset prices suggest 
' that price processes must follow a semimartingale (see [14] for instance). Recently, however, it has become common 
■T^J- , recognition that at ultra-high frequencies the financial data is contaminated by market microstructure noise such 
' as rounding errors, bid-ask bounds and misprints. Motivated by this, the statistical inference for semimartingalcs 
, observed at a high frequency with additive observation noise has become an active research area during the past 
' decade. 

On the other hand, since in this paper we are interested in the statistical inference for two assets observed 
at a high frequency, we face another important problem. That is, we may observe the data in a nonsynchronous 
manner. The classical theory of stochastic calculus suggests that the so-called realized covariance can be used for 
measuring the covariation of two assets if the sampling is synchronous. Therefore, it is a naive idea that first we fix 



5_( . 

, a sampling frequency (e.g. per five minutes) and generate new data sampled at this fixed grid by the previous-tick 
interpolation scheme and then we compute the realized covariance from the synchronized data. However, Hayashi 
and Yoshida [22] shows that this method suffers from a serious bias known as the Epps effect described in [16], 
so we need a different approach to deal with this problem. [22] proposed the so-called Hayashi- Yoshida estimator, 
which is identical with the realized covariance in the synchronous case and a consistent estimator for the quadratic 
covariation of two discretely observed continuous semimartingalcs even in the nonsynchronous case. The asymptotic 
theory of the Hayahsi- Yoshida estimator has further been developed in [21], [23, 24] and [13]. Another important 
theoretical approach to nonsynchronicity, a Fourier analytic approach, has been developed in Malliavin and Mancino 
[33, 34] and Clement and Gloter [11]; besides Ogihara and Yoshida [37] have recently developed the quasi-likelihood 
analysis of nonsynchronously observed diffusions in a parametric setting. 

In this paper we consider two diffusion processes observed in a nonsynchronous manner as well as contaminated 
by microstructure noise. Our aim is to estimate the integrated covariance of the diffusion processes in a high- 
frequency setting by coping with both of the observation noise and the nonsynchronous sampling simultaneously. 
Recently, various authors proposed hybrid approaches combining a method to de-noise the data with another method 
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to deal with the nonsynchronicity in order to attack this problem. One direction in such approaches is that we 
first use the refresh sampling method for synchronizing the data and then construct a noise-robust estimator. This 
method was first applied in Barndorff-Nielsen et al. [4] in which the realized kernel method proposed in [3] was used 
for de-noising, and further developed by [1], [8], [25], [43] and [45] with using other de-noising methods. Another 
direction is using a Hayashi-Yoshida type approach to deal with the nonsynchronicity. Bibinger [6] proposed to 
synchronize the data by applying a Hayashi-Yoshida type synchronization called the pseudo-aggregation algorithm 
first. In a second step, a multiscale type estimator like in [44] is constructed from this synchronized data. The 
obtained estimator is called the generalized multiscale estimator. Christensen et al. [8] proposed to de-noise the data 
by applying the pre-averaging method introduced in [40] (and further studied in [27]) first. After that, they construct 
a Hayashi-Yoshida type estimator called the pre-averaged Hayashi-Yoshida estimator from the pre-averaged data. 
On the other hand, recently Corsi et al. [12] proposed a new estimator which is not the hybrid one. 

Our estimation approach is based on the pre-averaged Hayashi-Yoshida estimator in the above, but we slightly 
modify this estimator for a technical reason. In Christensen et al. [9] the associated central limit theorem for that 
estimator has been shown, but it is restricted to the case when observation times are deterministic (or random 
but independent of the observed processes) and some of important sampling schemes in practice, like the Poisson 
sampling schemes, are excluded. In fact, the asymptotic variance given in their theorem has a quite complex form 
which depends on the special forms of the sampling times considered in that paper, so that the author guesses one 
cannot expect to extend this result to more general sampling involving the Poisson sampling schemes. For this 
reason, we first synchronize the sampling times partly. After that, we construct the pre-averaged Hayashi-Yoshida 
estimator from this new data. Then, we can compute the asymptotic variance due to Lemma 3.1 in Section 3. This 
procedure is done in the same spirit as that discussed in Section 6.3 of [7]. 

In addition to the above problems, we also consider two kinds of endogeneity; one is the dependency between 
the microstructure noise and the diffusion processes, and the other is the dependency between the sampling times 
and the observed processes. The first one is motivated by an empirical analysis of Hansen and Lunde [19] as well as 
some microstructure noise modeling in microeconomics such as [18]. Especially we will involve an asymptotically 
non-degenerate term which is correlated with the returns of the diffusion processes in the model of microstructure 
noise since [19] indicates the presence of such a structure. On the other hand, the second one is motivated by the 
recent studies on this topics in the absence of microstructure noise. See [17], [20], [24], [32] and [38] for details. 
Robert and Rosenbaum [42] also considers these two types of endogeneity in a framework different from the model 
with additive observation noise, which they call the model with uncertainty zones. In their framework, however, 
the observation errors are asymptotically degenerate. In this paper, we will show a central limit theorem for the 
estimation error of the proposed estimator in the situation explained in the above (see Theorem 3.1). 

Usually a certain blocking technique is used in the proofs of the central limit theorems for pre-averaging esti- 
mators (see [27], [39], [28] and [9]). In this paper, however, we do not rely on such a technique but a technique 
used in [24] for the proof of the central limit theorem for the Hayashi-Yoshida estimator. This is based on Lemma 
4.2 which tells us that in the first order the estimation error process of our estimator is asymptotically equivalent 
to the process M" defined in Section 4, which has a structure similar to that of the estimation error process of the 
Hayashi-Yoshida estimator. This enables us to apply arguments that mimic those in [24]. The only thing different 
from [24] is the computation of the asymptotic variance process, but we can pass through this problem due to the 
modification explained in the above. 

Lemma 4.2 has another important implication for the asymptotic theory of our estimator. That is, we can 
deduce a law of large number for our estimator, which can be regarded as a counterpart to Theorem 2.3 in [21]. 
This will be presented in Section 5.1. 

The organization of this paper is the following. In Section 2 we introduce the mathematical model and explain 
the construction of our estimator. In Section 3 the main result in this paper is stated. Section 4 provides a brief 
sketch of the proof of the main result, while in Section 5 we deal with some topics related to statistical application 
of our estimator. Most of the proofs will be put in Section 6-13. 

2 The setting 

We start by introducing an appropriate stochastic basis on which our observation data is defined. Let i?*^*^^ = 



(f](o)^jF(o)^r(o) ^ (J-f))tgR^,p(o)) be a stochastic basis. For any t € we have a transition probability 
(5t(w(°\d0) from (1^(0), 7"^'°^) into R^, which satisfies 




(2.1) 
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We endow the space fl^^^ = (R2)[o,oo) ^-^^^1 the product Borcl a-field and with the probabihty dw^^)) 
which is the product (8)teitt+<9t(w^°\ •)• We also call (et)teR+ the "canonical process" on and the filtara- 

tion T^^^ = a{es]s < t). Then we consider the stochastic basis B = (fJ, F = {Tt)t£M+, P) defined as follows: 



P(dc^(o),dL.(i)) = p(o)(dw(°))Q(t^("),dc^(i)). 

Any variable or process which is defined on either fi'-'^-' or fi'^-* can be considered in the usual way as a variable or 
a process on CI. 

Next we introduce our observation data. Let X and Y be two continuous semimartingales on B'-^K Also, we 
have two sequences of F^^'-stopping times {S'^)i£z+ and (r-')jgz+ that are increasing a.s., 

S"* t oo and t oo. (2.2) 

As a matter of convenience we set S^^ = = 0. These stopping times implicitly depend on a parameter n € N, 
which represents the frequency of the observations. Denote by (fo„) a sequence of positive numbers tending to as 
n — >■ oo. Let ^' be a constant satisfying < ^' < 1. In this paper, we will always assume that 

r„(t) sup {S' A t - S'-^ A t) V sup {T^ A t - T^-^ At) ^ Op(6«') (2.3) 
as n — >■ oo for any t G M+ . 

The processes X and Y are observed at the sampling times (S"*) and (T^) with observation errors (C/J^)igz+ and 
{U^j)j£Z+ respectively. We assume that the observation errors have the following representations: 

Here, et = {ef,eY) for each i, while and are two continuous semimartingales on B'^^^ We can take 
Z'^ = and = (f^Y for some constants (j)"^ and (/)^, so that the observation errors can be correlated 

with the returns of the latent processes X and Y. For this reason we will refer to (bn^^'^{Z-^i — Zgi_i))i^z+ and 
(bn^^'^{Z^j — Z^3_i))jgz+ as the endogenous noise. The factor 6^^^^ is necessary for the endogenous noise not to 
degenerate asymptotically. Such a kind of noise appears in [4], [15], [19], [30], [31] and [36]. After all, we have the 
observation data X = {Xsi)i^z+ and Y = {YT] )j£Z+ of the form 

Now we explain the construction of our estimator. First we introduce some notation. We choose a sequence fc„ 
of integers and a number 9 G (0, oo) satisfying 

fc„ = 06-1/2 + 0(6-1/4) (2.4) 

(for example fc„ = \9bn^^'^~\). We also choose a continuous function g : [0, 1] ^ M which is piecewise with a 
piecewise Lipschitz derivative g' and satisfies 

5(0) = .g(l) = 0, i^HY := / 9{x)dx ^ (2.5) 

Jo 

(for example g{x) = x A {1 — x)). We associate the random intervals /* = [S'^~^,S^) and = [T^~^,T^) with the 
sampling scheme (S") and (T^) and refer to I = (/*)igN and J' = (J^)jgN as the sampling designs for X and Y. 
We introduce the pre-averaging observation data of X and Y based on the sampling designs I and respectively 
as follows: 

X{Xy= ^ ^Ti^Vxs.+P-Xs^+P-i), Y(J)^ = ^ 5 ('|_') (Yj,,+, - Yj,,^,_0 , *,j = 0,l,.... 

p—l ^ ^ ^ q—1 ^ ^ ^ 



The following quantity was introduced in Christensen et al. [8] : 
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Definition 2.1 (Pre-averaged Hayashi-Yoshida estimator). The pre-averaged Hayashi-Yoshida estimator, or pre- 
averaged HY estimator of X and Y associated with sampling designs I and is the process 

^ oo 

P7JF(X, Y;I, J)" = — —2 ^ X(I)''Y(J')^l{[si s.+fc„)n[j.j j.j+fc„)_^0}, i e M+. 

Remark, fn order to improve the performance of the above estimator in finite samples, it will be efficient to replace 
the quantity ^hy with X]p=i ^ 9{p/kn) in the above definition. Such a kind of adjustments often appears in the 
literature on pre-averaging estimators. 

As mentioned in Section 1, we modify the above pre-averaged HY estimator by applying an interpolation method 
similar to the refresh sampling method for the technical reason. The following notion was introduced to this area 
in [4]: 

Definition 2.2 (Refresh time). The first refresh time of sampling designs I and J is defined as EP = S^WT^ , and 
then subsequent refresh times as 

R'' := min{S"|S" > R''-^} V min{TJ |T^ > R^'^}, fc = 1, 2, . . . . 

We introduce new sampling scheme by a kind of the next-tick interpolations to the refresh times. That is, we 
define := S°, f " - T°, and 

S'' ■.= mm{S'\S' > R''-'^}, f'':^mm{T^T^>R''~^}, A; = 1,2,.... 

Then, we create new sampling designs as follows: 

P ■.^[S''-\S''), > := [f'^-i,?^-), I:=(?)^eN, J '.^ {J'),&,. 

For the sampling designs I and obtained in such a manner, we will consider the pre-averaged Hayashi-Yoshida 
estimator PHY{X,Y)" := Pijy(X, Y; I, J)". 

One of the advantage of working with the refresh time is described by the following proposition: 

Proposition 2.1. The following statements are true. 

(a) S'' V f'' = R'' for every k. 

(b) (5* < f J) ^{i< j) and {§' > f J) ^ {i > j) for every i,j. 
Proof, (a) Obvious. 

(b) Since T-* < R^ < 5'-'+^, {S^ < T^) implies 5* < 5'-'+^, hence i < j. Consequently, we obtain the former 
statement. By symmetry we also obtain the latter statement. □ 

3 Main results 

We start with introducing some notation and conditions in order to state our main result. We write the canonical 
decompositions of X, Y, and as follows: 

X^A^+M^, Y = A^ + M^, Z^=A^+M^, Z^ ^ + . (3.1) 

Here, A-^ , A^ , ^ and ^ are continuous F^^-'-adapted processes with locally finite variations, while M^, M^, 
and are continuous F^^^-local martingales. For each i, j G Z_|_, let 

Since {P n 7^ 0) ^ {\i - i\ < K) by Proposition 2.1(b), we have 

00 00 

^ K^^ < 2kn + 1, - 2'^'" + 1 (3-2) 

3=0 ^=0 

for any i, j G 
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For two real- valued bounded measurable functions a, (3 on M, set 



E - 

i=(p-A:„ + l)Vli=(<}-fc„+l)Vl 
1 px+u+1 

I a{u)j3[v)(lv<lu. 

Jx+u-l 



p — I 



The following lemma, which is a counterpart of Lemma 7.2 of Christensen et al. [9], is the key to calculation of the 
asymptotic variance of the estimation error of our estimator: 

Lemma 3.1. Let a,/3 : M — > M &e two piecewise Lipschitz functions satisfying a(x) = /3{x) = with x ^ [0,1]. 
Then we have 



sup 

p.q:p,q>kn 



q-p 



as n —> oo . 

Proof. For p^q~> kn, we can rewrite Ca^pij), q) as 



i,j=0 



By definition, we have Rp ^ = ^{sp-^<fi-i+''n sp-'+''^>fi-i}- Moreover, by Proposition 2.1(b) we have 

{SP-' < f , SP-'+''- > f'i-^) => {q-p + i-kn<j <q-p + i + kn), 

iq-p + i-kn<j<q-p + i + kr,)^ {3"-' < f «-^+'^" , > f «-^'). 

Hence we obtain 

fc„-l / . s [(g-p+i+fc„)VO]A(fc„-l) 



i=0 



E 

i=[('^-p+^-fc-^)A(fe„-l)]vo 



uniformly in p, q. Note that q ^ p + i — kn < q — p + i + kn and a{x) = P{x) if a: ^ [O7 l]i we have 



fe„-i 



Ca,/3(p,g) = p E 



kn 



E /3(ir)+o,(6y^) 



□ 



uniformly in p, g. Therefore, the piecewise Lipschitz continuity of a and /S completes the proof. 

Next, let Np = 'EkLi ^{B''<t}, K'^ = Efeli ^{s>'<t} ^t"'^ = Efcli l{f''<t} *3ach i e M+ and 

for each k e N. Here, for each t e IR+ wc write S'^ ~ sup^i^g^ and T*^ = supj^^^^k Note that S'''' and f'^ 
may not be stopping times. 

Let ^ be a positive constant satisfying i < ^ < 1. Furthermore, let H" = (■H")tgH^ be a sequence of filtrations 
of T to which TV", A''"'^ and A'^"'^ are adapted, and for each n and each p > we define the processes x", G{p)'^, 
F{p)'^'\ F{p)"'^ and F(l)".i*2 by 



when s e r'''. 

The following condition is necessary to compute the asymptotic variance of the estimation error of our estimator 

explicitly. For a sequence (X") of cadlag processes and a cadlag process X, we write X" ^'^'^'> X if (X") converges 
to X in probability for the Skorokhod topology. 
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[Al'] (i) For each n, we have a cadlag H"-adapted process G" and a random subset JV^ of N such that (#A/'^),igN 
is tight, G(l)^fc_i = G^fc_i for any fc € N — A/',j , and there exists a cadlag F^^^-adapted process G satisfying 

that G and G_ do not vanish and that G" ^^-^-^ G as n — >■ cxj. 

(ii) There exists a constant p > 1/^' such that (supo<5<t G{p)^)^^j^ is tight for ah t > 0. 

(iii) For each n, we have a cadlag H"-adaptcd process x'" and a random subset A/"^ of N such that {^Af^n^f^ 
is tight, x^fc-i = x'lik-i for any fc G N — A/"^, and there exists a cadlag F^^^-adapted process x such that 

, Sk.p. 

X > X as n — )- oo. 

(iv) For each n and Z = 1, 2, 1 * 2, we have a cadlag H"-adaptcd process F^'^ and a random subset Ml^ of N 
such that (#A/',j)„gN is tight, F{l)^l_i = F^'k-i for any fc e N — M^, and there exists a cadlag F^^^-adapted 
processes F^ satisfying i^"'' pi as n — > oo. 

(v) There exists a constant p' > 1/^' such that (supQ<g<j -P"(p')"'OrieN ^® tight for alH > and / = 1, 2. 

Remark 3.1. A kind of conditions such as [Al'](i)-(ii) and [Al'](iv)-(v) appears in [4], [20] and [38]. The condition 
[Al'](iii) is satisfied when (S*') = (T^) (a synchronous case) with x = 1 or when 5* 7^ for all i,j> 1 (a completely 
nonsynchronous case) with x = 0, for example. 

Next, we introduce the following strong predictability condition for the sampling designs, which is an analog to 
the condition [A2] in [24]. 

[A2] For every n,i e N, and T* are G^"^-stopping times, where G^") = (^f"')tGE+ is the filtration given by 

The following conditions are analogs to the conditions [A3] and [A4] in [24]: 

[A3] For each V,W = X, Y, , , [V, W] is absolutely continuous with a cadlag derivative, and for the density 
process / = [V, W]' there is a sequence (ak) of F^^^ -stopping times such that for every k and any A > 0, we 
have a positive constant Ck.\ satisfying 

E [[/;," - /,?|'|^riAr.] < Ck,xE [In - r2|i-^|.F,,Ar.] (3.3) 

for any bounded F^^^-stopping times ri and T2, and / is adapted to H". 
[A4] ^ V ^ < C' and (2.3) holds for every t e R+. 

The following conditions, which are analogs to the conditions [A5] and [A6] in [24], are necessary to deal with 
the drift parts: 

[A5] , , ^ and ^ are absolutely continuous with cadlag derivatives, and there is a sequence (cTfe) of 
F*^°)-stopping times such that for every fc we have a positive constant Gfc and Afc G (0, 3/4) satisfying 

-/rM'l-^rAt] <Gfci?[|t-r|i"^'=|j-,^t] (3.4) 

for every i > and any bounded F^^^-stopping time r, for the density processes / = (^A^)\ (A^)', (A"^)' and 

[A6] For each t e R+, h-^H^it) = Op(l) as n ^ c», where 77„(i) = X]^! |r''(OI^- 
The following condition is a regularity condition for the exogenous noise process: 
[N] (J \z^Qt{Az))t^^^ is a locally bounded process, and the covariance matrix process 

«'t(w(°)) = y" zz*Qt(w(°\d;z). (3.5) 

is cadlag and quasi-left continuous. Furthermore, there is a sequence (a^) of F'°)-stopping times such that 
for every fc and any A > 0, we have a positive constant Gfe^A satisfying 

< C^xh^-^ (3-6) 

for every i, j G {1, 2} and every t,h > 0. 



E 



I IT ''At 



'=A(t-/l)+ I 
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Remark 3.2. The inequalities (3.3), (3.4) and (3.6) are satisfied when w{f; h,t) = Op{h^^^) as /i — > oo for every 
t,X£ (0, oo), for example. Here, for a real-valued function x on M_|_, the modulus of continuity on [0,T] is denoted 
by w{x] 5, T) = snp{\x{t) - x(s)|; s, t g [0, T], \s-t\ < 6} for T,S > 0. This is the original condition in [24]. Another 
such example is the case that there exist an F'^^^-adapted process B with a locally integrable variation and a locally 
square-integrable martingale L such that f = B + L and both of the predictable compensator of the variation 
process of B and predictable quadratic variation of L are absolutely continuous with locally bounded derivatives. 
This type of condition is familiar in the context of the estimation of volatility-type quantities; see [20] and [28] for 
instance. Furthermore, in both of the cases / is cadlag and quasi-left continuous. 

We extend the functions g and g' to the whole real line by setting g{x) ~ g'{x) —Qiorx^ [0, 1]. Then we put 

2 j-2 j-1 



i^g^gix) dx, k := il}g-^g'{x) dx, k := I iljg,g'ix) dx. 

J-2 J -2 

We denote by D(K+) the space of cadlag functions on R+ equipped with the Skorokhod topology. A sequence of 
random elements X" defined on a probability space (fi, P) is said to converge stably in law to a random element 
X defined on an appropriate extension {Cl, JP, P) of (fi, P) if E\Y g{X^)] — >■ E\Vg{X)\ for any J^-measurable and 
bounded random variable Y and any bounded and continuous function g. We then write X" ^^''^ X. A sequence 
(X") of stochastic processes is said to converge to a process X uniformly on compacts in probability (abbreviated 
ucp) if, for each t>Q, supq<;^<( |X" — Xs\ — >-P as n — >■ oo. We then write X" X. 

Now we are ready to state our main result. 

Theorem 3.1. (a) Suppose [Al'](i)-(iii), [A2]-[A6] and [N] are satisfied. Suppose also ^ ^ 0. Then 



&-i/'*{Rff?(X,Y)" - [X,r]} ( w.dWs in 



as n ^ oo, where W is a one- dimensional standard Wiener process (defined on an extension of B) independent of 
T and w is given by 

wl = ^-^\.[en{[XUYl + {[X, Ylf}G, + e-^n{^l^^f + {^fxs)^}G-^ 

+ e-'T^{[xl^f + [y];*!! + 2[X, Yl^^^xs}]. (3.7) 

(b) Suppose [Al'], [A2]-[A6] and [N] are satisfied. Then 

h;y^{PHY{x,\Y - [X,Y]) 

as n ^ oo, where W is as in the above and w is given by 



+ 0-^73 {[X]^C + [Yl-^l'+2[X,Yyjl' - {[Z^,YlFl [X,Z^lF^f} 



(3.8) 



where 

= + [Z^r.Fj, C = *f + [Z'^YsF!, *f = ^I'xs + [Z^,Z^lF}*' 
A sketch of the proof is given in the next section. 



4 Stable convergence of the estimation error 

In this section we briefly sketch the proof of the main theorem. First we introduce some notation. For processes V 
and W , V •W denotes the integral (either stochastic or ordinary) of V with respect to W . For any scmimartingale 
V and any (random) interval /, we define the processes V{I)t and It by V{I)t = /Jl/(s-)dy, and h = li{t) 
respectively. We denote by $ the set of all real-valued piecewise Lipschitz functions a on R satisfying a{x) ~ for 
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any x ^ [O7 !]• For a function a on K we write = a[p/kn) for each n € N and p G Z. For any semimartingale 
any sampling design T) ~ {D'^)i^^ and any a G $, we define the process V{T>)\ for each i S N by 

fe„-i 

We introduce the following auxiliary regularity conditions: 

[CI] A^, A^, A^, A^, and [V,W] for V,W = X,Y,Z^,Z^ arc absolutely continuous with locally bounded 
derivatives. 

[C2] (J |zp(5t(dz))tgR_^ is a locally bounded process. 
[C3] 6„A^" = Op(l) as n — 7^ 00 for every t. 

We define by (3.5) whenever we have [C2]. 
Let 

L V f ^ 1 - iE^' - L V f ^ 1 - 

p=l q=\ 

and £^ are obviously purely discontinuous locally square-integrable martingales on B if [C2] holds (note that 
both (S**) and (T-') are F'^'-stopping times). Furthermore, if 4' is cadlag, quasi-left continuous and both (S**) and 
(T-') arc F'^°)-predictable times, then we have 

-.00 -.00 -.00 

Though and T*^ may not be stopping times, we have the following result: 
Lemma 4.1. The random variables 1^ and are -measurable for every k,t. 

Proof. Since {1^ = 1} = {S'' < t < S''} = C\.^[{S' < t < S''} U {t < S'' < S'}], we obtain = 1} £ J"/°^ and 
thus if is /'(^''-measurable. Similarly we can show that is J^j^'-measurable. □ 

Due to the above lemma, both of the processes 3t ■= X^^i J? ^^'^ F^^^-adapted. Therefore, 

we can define the following processes: 

Then we set 

il^ = + (A:„v^)-i3'', 11^ = €^ + {knVbn)-'V. 
For any semimartingales V, W and any a, /3 G set 

£a,M"i^: WY' = Mr)- • T^/3(^^) + WpiJ^). . t4(?) 

for each i,j e N. We define the process M(/c)" (fc = 1, 2, 3, 4) by 

[WHYknY [WHyknY 

.^00 - CXD 

where ^j"* = l{/i(t)nj3(t)/0}j ^'^d set M" = X]fe=i ^C^)"- Then we have the following lemma. 
Lemma 4.2. Suppose that (2.3) anc? [C1]-[C3] are satisfied. Then 

6-''{p5t(x,y)" - [X,y] -M"| ^0 

as n ^ 00 for any 7 < ^' — 1/2. 
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We give a proof of Lemma 4.2 in Section 6. The above lemma implies that we may consider M" instead of the 
estimation error of our estimator as far as ^' > 3/4. 

Lemma 4.3. Let V, W he two semimartingales and g, h are two real functions on R. For any i, j G and any 
t e R+, RfLg^hiV, W)t = k'l . Lg,h{V, W)t. 

Proof. By integration by parts we have 

Kl'Lg^niV, W)t = K'l . Lg^hiV, W)t + W)^ . Kl' + [K'\Lg^n{V. W)]u 

hence it is sufficient to show that Lg,h{V, W)- • Kl'' = [K'^-' , Lgji{V, W)]t = 0. Kl'' is a step function starting from 
at i = and jumps to +1 at i = R'^iiJ) when P n ^ 0. So, LgM{V, W)- • K^^ ^ Lg^h{V, W)rv :^ij)^t_Ki^ 
and [K^^,Lg,h(y,W)]t = Kl^ ALgj^{V,W)Rv ^ij^^.^. However, Lg,hiV,W)t = for t < R'^{i,j) by its definition. □ 

We momentarily assume that X, Y, and are continuous local martingales. Lemma 4.3 implies that M" is 
a locally square-integrable martingale. Therefore, we can define the quantities 93" := (M")t and ^ := (M", N)t 
for a locally square-integrable martingale N. Then we consider the following conditions. 

— 1/2 

[Al*] There exists an F-adapted, nondecreasing, continuous process {Vt)tm+ such that bn ' 93"^ -^p Vt as n — ^ oo 
for every t. 

[Bl] bn^^'^^Jf^t asn^oo for every t and any N e {X, Y, Z^ , Z^}. 

The next two lemmas imply that the above two conditions are sufficient for our stable convergence problem. 
They are proved in Section 7 and 8, respectively. 

Lemma 4.4. Suppose that [Al*] , [A4] and [C1]-[C3] are satisfied. Then for any square-integrable martingale N 
orthogonal to {X,Y,Z^,Z^) we have bn^^^ {M'^ , N)t -^^ as 71 —> oo for every t. 

Lemma 4.5. Suppose that [A4], [C1]-[C3] and [N] are satisfied. Then E,,:o<,s<t ^^^AM^I"* as n ^ oo for 
any t > 0. 

We consider the following conditions: 

[W] There exists an F-predictable process w such that V. ~ j]^ w^ds. 

[SC] bn^^^M."- -^'^^ M in D(IR-|.) as ti — > oo, where M = WsdWs, w is a some predictable process, and is a 
one-dimensional standard Wiener process (defined on an extension of B) independent of T. 

Proposition 4.1. Suppose that [Al*], [Bl], [A4], [C1]-[C3], [N] and [W] are fulfilled. Then [SC] holds. 

Proof. We apply Theorem 2-2 of [26]. Eq. (2.8), (2.9), (2.10) and (2.12) in [26] are satisfied with B = 0, = V and 
G = due to the assumptions and Lemma 4.4. Moreover, Lemma 4.5 yields Eq. (2.26) in [26] due to the definition 
of the compensator of a random measure. Consequently, we complete the proof. □ 

The left problem is to check the conditions [Al*], [Bl] and [W]. Following [24], we introduce some notation and 
conditions. For any locally square-integrable martingales M, N, Al', N' and any a, (3, a', (3' G 3>, let 

V:%,p,{M,N;M\N')t 

:=(M„ (iy , m;, iif)t{N0 ijy , N'p, ijy')t + {Ma {iy, {jy'UK- {if , {jy},. 

Then we introduce the following condition: 

[B2] For any M, M' e {A, any N, N' G {Y, (£^, 3^'} and any a, ^, a', /?' G $, 

b-'/-' {K'lki=').{Ll^{M,N)rL%{M',N')), 

as n — > OO for every t G 
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Let 



W;4 ^ 



and 



=7K:2 E'/'^'^s' fV^) V^^'.^' f V^) {[z^,x](F),[z^,F](J')* + 

+ [x,Y]{P), i{g,=f,<,} + fo-M3^,3n(>)t)) }, 



frn, 3i _ 
'^i ~„/,4 



and set V^^ = X]f=i ^t" ' + 2(V("'^^ + V^"'^'^). Then we have the following proposition, which enables us to work with 
V"', a more tractable process than QJ". The proof is given in Section 9. 

Proposition 4.2. Suppose that [A4], [C1]-[C3] and [B2] hold. Suppose also that 5* is cadlag and quasi-left contin- 
uous. Then QJ" = V"j" + 0p{bl!'^) as n oo for all t 

We modify [Al*]. 
[Al] There exists an F-adapted, nondecreasing, continuous process 

{Vt)tm+ such that 6„'/'v;" ^ Vt as n — >■ oo 

for every t. 

By Proposition 4.2, we can rephrase Proposition 4.1 as follows. 

Proposition 4.3. Suppose that [Al], [A4], [Bl], [B2], [C1]-[C3], [N] and [W] forV in [Al] are satisfied. Then [SC] 
holds. 

The condition [W] for V in [Al] can be checked by the following lemma, which is proved in Section 10. 

Lemma 4.6. Suppose that [Al'](i)-(iii), [A3], [A4] and [C2] hold. Suppose also that ^' is cadlag and adapted to H" 
for every n. Then 

(a) b-'/'j:Z=i^s^s (^)' {X)iH{Y){J^)t e^J^{xyAY)[,GAs, 

(b) b-'/'j:^^,^,^, {X,Y){ir>)t{X,Y){J% On f^{{X,YY,)^Gsds, 

(c) b-"'^^Y.Z=.^,., (^)'*|l*|^,l{5.vf,<.} e-^^S/o *^^*f GjM,s, 

(e) 6n'/'^E,°:,=i V'.,.' (^)' {X) (I^)t^ fl^f.<t} 0-^nJ^{Xy,^fds, 

(f) ^'n'^'iEp°?,=i^'.,.' {y)iH^'lhs^<t} O-^nJ^iYYM^ds 

as n —> oo /or every t. Furthermore, if [Al'](iv)-(v) hold in addition to the above assumption, then 
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(p) b,;^/'^E;:,=i^«',«' (^) (^) [^-^x](^),[z^,y](J^), -^'^ 0-'^p^[z^ ,xuz^ ,yifIf!g-'as, 

as n oo /or every t. 

The following proposition, which is an analog to Proposition 5.1 in [24], gives a sufficient condition for [B2]. The 
proof is given in Section 11. 

Proposition 4.4. [B2] holds true under [A2]-[A4], [N] and [C3]. 

It still remains to cheek the asymptotic orthogonality condition [Bl]. However, it will be shown that it is the 
same kind of task as solving [B2] . This phenomenon is also seen in [24] . 

Theorem 4.1. Suppose that X , Y , Z^ and Z^ are continuous semimartingales given by (3.1). 

(a) //[A1]-[A6], [N], [C3] and [W] are satisfied, then [SC] holds. 

(b) IfZ^ = Z^ ^0, [Al'](i)-(iii), [A2]-[A6j and [N] are satisfied, then [SC] holds for w given by (3.7). 

(c) If[AV], [A2]-[A6] and [N] are satisfied, then [SC] holds for w given by (3.8). 

It is worthy of remark that neither [A5] nor [A6] is necessary for local martingales as seen in [24]. 
Theorem 4.2. Suppose that X , Y , Z^ and Z^ are continuous local martingales. 

(a) //[A1]-[A4], [N], [C3] and [W] are satisfied, then [SC] holds. 

(b) IfZ^ = Z^ ^0, [Al'](i)-(iii), [A2]-[A4] and [N] are satisfied, then [SC] holds for w given by (3.7). 

(c) If[AV], [A2]-[A4] and [N] are satisfied, then [SC] holds for w given by (3.8). 

Theorem 4.1 and 4.2 are proved in Section 12. 
Proof of Theorem 3.1. The desired result follows from Lemma 4.2 and Theorem 4.1(b) and (c). □ 

5 Some related topics for statistical application 

5.1 Consistency 

In order to obtain our main theorem, we need to impose a kind of predictability such as [A2] on the sampling 
scheme. In fact, it is still an active research area to seek asymptotic theories of estimators for volatility-type 
quantities when sampling scheme is random and depends on observed processes even if neither nonsynchronicity 
nor microstructure noise is present; See [17] and [32] for instance. Such a situation, however, dramatically changes 
when we restrict our attention to the consistency of the estimators. As is well known, the classical realized covariance 
is a consistent estimator for the integrated covariance whenever the sampling scheme consists of stopping times and 
the mesh size of sampling times tends to 0. Furthermore, Hayashi and Kusuoka [21] verified such a result for the 
Hayashi-Yoshida estimator in the presence of the nonsynchronicity of the sampling scheme. The following theorem, 
which is a by-product of Lemma 4.2, tells us such a result is still valid for our estimator: 
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Theorem 5.1. Suppose (2.3) and [C1]-[C3] are satisfied. Then PHY{X,Y)" ^ [X,Y] as n —> oo, provided that 
> 1/2. 

The proof is given in Section 13. 

5.2 Poisson sampling with a random change point 

As an illustrative example of sampling scheme satisfying the conditions [Al'], [A2], [A4] and [A6], we shall 
discuss a Poisson sampling with a random change point, which was also discussed in [24]. 

First we construct the stochastic basis B^^'^ which is appropriate for the present situation. Let {fl',J-', {J-[), P') 
be a stochastic basis, and suppose that the semimartingales X, F, and are defined on this basis. Suppose also 
that 5* is (J'/j-adapted. Furthermore, on an auxiliary probability space (17", F" , P"), there are mutually independent 
standard Poisson processes (iVf), (N^) {k = 1,2). Then we construct = {n^°\T^°\F^°'> = {T^°^)tm+, P^°'') 

by 

Next we construct our sampling schemes. For each k— 1,2, let p^ ,p^ £ (0,oo) and let r*^ be an (J'j')-stopping 
time. Define {S_^) and (S"*) each as the arrival times of the point processes 7V"'^ = {N.npi-t) iV"'^ = (A^^piJ 
respectively. Let rj £ (0, |) and set = + . Then, we define (S'*) sequentially by 5*° = and 

^^^/^l^{—{Si~^<S'<T^}^i^n+S ){5>-i<^i + 5'"}| , * = 1,2, 

Here, for a stopping time T with respect to filtration (Tt) and a set A e Tt, we define by Ta{uj) = ^(a;) iiuj E A; 
Ta{oj) = oo otherwise. (T^) is defined in the same way using 7V"'^ = (N^pn), n"' = (iV„p2() and t,^ = t'^ + n^^ 

instead of iV"'"^, N'^'^ and respectively. 

Now we verify the conditions [Al'], [A2], [A4] and [A6]. First, [A6] is obviously satisfied. Next, [A2] can be 
verified with ^ = 7^ + 1/2 in a similar manner to the proof of Lemma 8.1 of [24]. Moreover, since r„(t) = Op (log n/n) 
as n — )• oo for any i > by Corollary 1 in [41], (2.3) holds for any ^' G (0, 1), hence [A4] holds true. Finally, let 
H" be the filtration generated by the cr-field T' and the processes N^'^ and A^"'^. Then [Al'] is verified by the 
following proposition. 

Proposition 5.1. We have [Al'] with x = and 

/ 1 1 1 \ / 1 1 1 \ , 

— T + =2 1 , -2 l{r2<,s<ri} + — + =2 ^ _i , _2 ^{t^Vt^Ks}, (5-1) 

P^+P J \P P P +P j ^ 

,11 2 1 1 

~ 2 2 ~ 2 2 r '.^■"'i 



Proof. First, it is evident that [Al'](ii)-(iii) and (v) with x = hold true. 

Next, let A^, € (0,oo), and consider a Poisson process (Nf) with intensity A^ + A^. Moreover, let {r]k)k£N be 
an i.i.d. random variables independent of N with Piiji = 1) = 1 — P{i]i = 0) = A^/(A^ + A^), and set = J2^=i Vk 
and = Nt — N^. Then, a short calculation shows that for each fc = 1, 2 N'' is a Poisson process with intensity 
A'^. Furthermore, Theorem 2 in [10] implies that and N"^ are independent. Using this fact, we can show that 
G(l)^fc_i = G^fc_i for any k e N — Af^. Here, G" denotes the process defined by the right hand of (5.1) with and 

replaced by and t^, and N° = {k\R''~^ < t,\ < R^} U {k\R^~^ < tI < i?*^}. Since #A/;'J < 2 and G" G 
as n — )- oo, we conclude that [Al'](i) with (5.1) holds true. 

Finally, if R'' =S'',wc have 3''+^ = R.'' and f'' < f '=+1 < R'', hence we have I'^+i n = and S''^ V f '=+1 < 
gk ^ f fc+i^ Similarly we have l'' D J''+^ = and 3''+^ V T*^ < 3''+^ A f if i?*-' = f''. Combining these facts with 
an argument similar to the above, we can also show that [Al'](iv) with (5.2) holds true, hence we complete the 
proof. □ 
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5.3 A round-off error model 

In this subsection we illustrate an example of the microstructure noise model involving rounding effects. It is a 
version of Example 2 in [27]. The round off error is known as one of the sources of the Epps effect; see [35]. 

In the remainder of this subsection, we assume that = = 0. Suppose that the observation data is given 
as follows: 

Xs. = 7^7(^5. +uf)/7''J, Y^, = i^\iYT,+u^)h^\. (5.3) 

Here, 7'^,7^ > 0, {uf) and {u^) are mutually independent i.i.d. sequences of random variables independent of X 
and F, and for a real number x we denote by \x\ the unique integer a such that a — 1/2 < x < a-\- 1/2. Suppose 
that uf and each are uniform over [— 7'^/2, 7'^/2] and [—7^/2,7^/2] respectively. Then, this model can be 
accommodated to our framework in the following way: For a real number x, let be the Bernoulli distribution 
taking values 7^^(15^ + sign(— 5^)) and j^S^ with probabilities \6^\ and 1 — \S^\, where = \x/j^ \ — x/7'^ 
and sign(a) is equal to 1 if a > and —1 otherwise. Similarly we define fj,^ with replacing X by Y. After that, 
we define Qt{u}^^\dxdy) — /i^^^^((,)^(da;)/iy^^^(o)j(dj/). We can easily confirm (2.1) and (5.3). Moreover, since the 
function x H> [ [xj — .t[ is Lipschitz, the condition [N] holds if we have [CI]. 



6 Proof of Lemma 4.2 

Throughout this section, we fix a constant 7 such that 7 < ^' — 1/2. First note that for the proof we can use 
a localization procedure, and which allows us to systematically replace the conditions [C1]-[C3] by the following 
strengthened versions: 

[SCI] [CI] holds, and {A^)' , {Af^)' , {A^)' ■. {^)' and [V, for each V,W ^X, Y, Z^ , Z^ arc bounded. 
[SC2] (J |z|^(5t(dz))igR^ is a bounded process. 

[SC3] There is a positive constant K such that bnNn{t) < K for all n and t. 

We write f„ — b^^ . Next, let Vn ~ inf{t|r„(t) > f„}, and define a sequence (S'')igz+ sequentially by 

\ S''~^+r„ otherwise. 

Then, (S") is obviously a sequence of F^^^-stopping times satisfying (2.2) and supjgis}(S" — S"~^) < r„. Furthermore, 
for any < > we have P(n,;{^2 A i ^ A t}) < P{vn < t) ^ as n ^ cx) by (2.3). By replacing {S') with (T^), 
we can construct a sequence (T^) in a similar manner. This argument implies that we may also assume that 

sup r„(i) < f„ (6.1) 

tea+ 

by an appropriate localization procedure. 

Set A{gy^ = g^^^ - for every For a process V = {Vt)teM+, let 

fc„ - 1 fc„ - 1 

p=0 9=0 

for each t <E R+ and i,j G N. 

Lemma 6.1. Suppose A^ , A^ , [X], [Y], A^ , A^ , [Z^] and \Z^\ are absolutely continuous with locally bounded 

derivatives. Suppose also (6.1) holds. Then a.s. we have 

limsupsup^HlElL < ||.g||oo sup |[X]'J, lim sup sup ^^^^^^SE^ < L sup |[Z^]'J, (6.2) 



n^oo ^eN /2fc„f„ log 0<«<* /2fc„f„ log -i 



0<s<t 



limsupsup^SElL < sup |[r]^|, hmsupsup^^^^^pJiElE^ <L sup |[Z^]'J (6.3) 

J6N ^2knf„ log ^ 0<s<t n^oo ,gN y'2fc„f„ log ^ 0<s<t 

for any t > 0, where L is a positive constant which only depends on g. 
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Proof. Combining a representation of a continuous local martingale with Brownian motion and Levy's theorem on 
the uniform modulus of continuity of Brownian motion, we obtain 



lim sup sup 



<5->+o s.ue[Q.t] j2(51oKi 

\s — u\<d 



< sup lim sup sup 



|3s 3u 



Xy I 



< sup 



.5^+0 s.ue[Q.t] ,/2(51ogi o<-''<* 

\s — u\<6 



Since Xg{I)l = - Ep=o ^ ^(s)^ (^S'+PAt ~ ^'^'^ \M9)p\ < T^llfflU, we obtain the first inequality in (6.2) 



On the other hand, since Abel's partial summation formula yields ^p{T)l = X]p=o^ ^"{(sOp ~ (sOp+iKS'^ 



S»+PAt 



3f._,^^) and - Ep=o' ^4A(5)^- A(5)^+J(3|+,^^-3|_,^P, and A{g);^, - A{g); = - J^^l'^/''^ {g'ix + 

^/kn) — g'{x)}dx, the piecewise Lipschitz continuity oi g' implies the second inequality in (6.2). 

By symmetry wc also obtain (6.3). □ 

We can strengthen Lemma 6.1 by a localization if we assume that (6.1) and [SCI] hold, so that in the remainder 
of this section we always assume that we have a positive constant K and a positive integer tiq such that 



sup 

ieN 



\X,{m^)\ + \^f,{I)liLo)\ + \5fiI)l{co)\ , ^ \Y,iJ)lico)\ + \^l{J)iiu:)\ + \3^iJ)liLo)\ 



y/2k„rn\ \ogb„ 



sup ■ 



n Tn I log b 

n I 



< K (6.4) 



for alH > and w G if 7i > no. Moreover, we only consider sufSciently large n such that n> tiq. 
Let 



1,3^1 



^ oo 

^ OO 



The following lemma tells us that the edge effects are negligible. Throughout the discussions, for (random) 
sequences (x„) and (j/n), Xn ^ Vn means that there exists a (non-random) constant C £ [0, go) such that x„ < Cyn 
for large n. We denote by Eq a conditional expectation given i.e. i?o[-] E[-\T'^'^^]. 

Lemma 6.2. Suppose that [SC1]-[SC3] and (6.1) are satisfied. Then we have h~'^ {PHY {X,^^ - (I + II + III + 
IV)} ^ as oo. 

Proof. We can rewrite PHY{X, Y)J' and It + IIj + IIIj + IV* as 



P£rr(x,Y)^ 
1 



^9(^)tYs('^)t-^/l{Si + '!nVfj + '=n<t} + ^ ^(^)'Y(j')-'/^'"'l0i + fc„yf j + fc„<(J 

— l i,j:i—0 or j— 



and 



It + lit + Hit + ivt = . , 5^ x,(x)jY,( j)^i^t^n^g.^f,<,j. 



where Xg{I)\ = Xg{I)\ +il^(I)t and YgiJ^Yt = yg(J')t +il^(J')t. hence we can decompose the target quantity as 



(It + lit + HI* + iVt) - Pi/r(x, Y)^ 
1 



{i>HYknY 



^s(^)tY9(>^)t-^/l{Sivf J<t<S'+'=n Vfj + ^n } ^s(^)tY(J')°-ft^f°l|g-i + 



fcn VT*" <t} 



1=1 



:Ait + A2,t + A3t + +A4t. 
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Consider Ai_t. The Schwarz inequality yields 



En 



sup |Ai^ 

0<s<t 



<- 



sup 



{i'HvknY 0<s<t 









2 








2 






sup 








sup 






} 




0<u<t 








0<u<t 









1/2 



^^s -^{SivT-)<s<S'+'="VTJ + '=n}- 



Since both and ^ are martingales on (fi'^^ F'^^ (5(aj'^°', dz)) for each a;(°\ we have 



So 



sup 

.0<M<t 



sup 

0<«<t 



(6.5) 



by the Doob inequality and [SC2]. Combining this with (6.4), we obtain 



En 



sup |Ai^ 

0<s<t 



< 



r„| log bn\ 



sup 

0<s<t 



< fc„r„| log&„|, 



and thus we conclude that b~'^ supQ<^<t |Ai — 5-p as n — > oo. 

Similarly we can show that b~'' supQ<^<( \-^i,s\ as n — > co for / = 2, 3, 4. After all, we complete the proof 
of lemma. □ 

We define the processes DJl-^ , 971^, 21"^ and 21^ as follows: 



Let Kf — l{/p(j)nj<j(t)5<^0} each p,q,t. Then Proposition 2.1 yields 

oo oo 
9=1 p=l 

for every p, t. Furthermore, we have the following result: 

Lemma 6.3. Suppose that [SC1]-[SC3] and (6.1) are satisfied. Then we have 

k„-l 



21* 



(6.6) 



sup 

0<s<t 



(6.7) 



as n ^ oo for any a,/3 S $, 1/ S {M^, e^^, 971^, A^, 21^}, 1^ G {Af^, £^,971^, A^,2t'^} anrf t > 0, where 
L{V, Wft'^ = y(/P)_ • W{J'i)t + M^( >)_ • V"(/P)t /or each p, q, t. 

Proof. First, by a localization procedure based on a representation of a continuous local martingale with Brownian 
motion and Levy's theorem on the uniform modulus of continuity of Brownian motion, we may assume that there 
exist positive constants K and 5q such that 



sup = < K 

s,«e[o,i] A/2J|log(5| 

|,s-«|<i5 



(6.8) 



whenever Q < 5 < 5q. Moreover, we only consider sufficiently large n such that r„ < ^o- 

First we consider the case that V £ {M^, g-^, 971-^} and W € {M^,e^,m^}. when 1 < p < fc„ - 1 and 

1 < q < fc„ - 1, we have V < S'+p-^ V f^+i-^ < 5*+^ A f < A f on {fp n J« 7^ 0}, hence we 

can decompose the target quantity as 



fc„-i 



E E </3^i(^^,W^)^+'''^'+'^s+^'^'+'' 

= E I E + E I ^p^l'Liv, wy+p^^-^^K:+p'^+^ 

ij — l Kp,q>0 p—0 or q—0 ) 



^l,s -r i^2,s- 
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Consider Ai^s first. By an argument similar to the proof of Lemma 4.3, we can rewrite it as 

and thus Ai.. is a locally square- intcgrable martingale because both V and W are locally square- intcgrable mar- 
tingales. Therefore, it is sufficient to prove (Ai^.)^ = Op{b'^ ■ k^) as — )■ oo for any s > due to the Lenglart 
inequality. Since 



OO / p — l q—l 

^l.s = X! X] X] -p-ll-q-J 

p,q=l \i=(p-fc„ + l)Vl j = ((j-A;„+l)Vl 



we have 



(Ai,)s < kf. 



OO OO 

R'PJKP^'' ,^^V{TP). V{Tp' )-•{]¥){ J'')} + KPJKPJ' •^^W{J'').W{J''')-»{V){IP)} 



.p,p' ,g— 1 



p,q,q' = l 



liV^e^ 01 (6.8), [SC2], the Schwarz inequality and (6.6) yield 

Eo[l]<k^nrn\logb„\Eo[{W)s]. 
On the other hand, since e^(/f)t€^' (/"')« = fc,7'ef,e|,. l{spvp'<(j and [£^1(J«)t = KH^J^'^if-Kt}' have 

£^(F)_£^(F')_ . [€^]iJ'^), = k-^^el,{elJ'l^g,,,,^f,^^y (6.9) 
Therefore, [SC2]-[SC3], the Schwarz inequality and (6.6) yield 



En 



OO 

Kl^K^^" • {(S''(F)_(S^(F')- • [^''KJ'^)} 



p,p',q=l 



< k" 



Note that Proposition 4.50 in [29], [SC1]-[SC3] and the above estimates imply that I = Op{kf^rn)- By symmetry 
we also obtain II = Op(fc^f„). Consequently, we conclude that (Ai .)s = Op{h'^ ■ k^) because ^'/2 — (^' — 1/2) = 
(l-C')/2>0. 

Next consider Aa,^. Since integration by parts yields L{V, wy+P'^+'^ = V{I'+p)sW{J^+'^)s - f+Pj^+'' • [V, W]s, 
(6.8), [SC1]-[SC3], the Schwarz inequality and (6.6) imply that 



Eo 



sup |A2„,| 
0<s<t 



< f„| log 6„| ^ ^l^"^'^' ^ ^""1 log ^"1 ■ ' = ■ log bn 

i,j = l 0<p,g<fc„-l 
p— or g— 

Hence we obtain supQ<g<j |A2,s| = Op{k'^ ■ 6^). Consequently, we conclude that (6.7). 



Next we consider the case that V e {^^^,21^^}. Since integration by parts yields 

LiV,Wy+P^^+'^ = ViI'+P)sW{J^+'^)„ 
8), [SC1]-[SC3], the Schwarz inequality and (6.6) imply that 



En 



sup 

0<s<t 



fc„-l 



Y Kl' Y a;/3^L{V,Wy+P-^+'^Kl+P-^+'> 



OO k-n —1 

<Vf„|log6„| Y E Kl+P'^^'\I'^'it)\ 
i,j=i p,q=o 

<b(^'y/\]^\-kl 



Since ^'/2 > ^' — 1/2, we conclude that (6.7). By symmetry we also obtain (6.7) in the case that W £ {A^,'Qi^}. 
Consequently, we complete the proof of the lemma. □ 
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Lemma 6.4. Suppose that (6.1) and [SC1]-[SC3] are satisfied. Then 



(a) 6-''{I-[X,y]-M(in^0, 
(c) 6-'^{III-M(3n^0, 



(b) 6-''{II-M(2n^0, 
(d) 6;^^{IV - M(4)"} ^ 



as n —> oo. 



Proof, (a) By integration by parts we have 



Since 



-. CXJ 

l,j=l 



fc„-l i+k„~lj+k„~l 
p,q—0 p—i q—i 



we obtain 



VV-nr \ +i) vl j=(g-fc„ +1) VI 



On {/P n ,79 7^ 0} we have 5^-^ < and T^-^ < , hence for i e {(p - fc„ + 1) V 1, . . . ,p - 1} and j G 
{(g - fc„ + 1) V 1, . . . , q - 1} we have S' < f ^+'="-1 and fi < so that K'i = 1. Therefore, for p,q>kn we 

have 

E E = E .^r 

i=(p-fe„ + l)Vl j=(g-fc„ + l)Vl \ i=l / 

on {/P n J« 7^ 0} because 5(0) = 0. Since {PLJl) • = l{jpnj,_^0j(/^,?;) • [X,y]t, we obtain 

It-M(l)r 
1 



E^r E i{f.nj./0}(^"^-)-[^,^]t 

- E ( E E 5p%5g%i?*^|l^7.nJ./0}(^*^^^)-[^,i^]* 

p,q:pAq<k„ \ i=(p-fc„+l)Vl j=(g-fc„ + l)Vl 



Since ^^^^f. (Sf=i ^5?) = 1 + '^(^n ^) by the Lipschitz continuity of g and 



sup 

0<s<t 



p^q—kji 



iTlJl).[X,Y]s-[X,Y], 



o 



by [SCI] and (6.1), we have supQ<^<j |Bi^s — [-'i^, Y]s \ = Op{b^). Moreover, [SCI] and (6.1) also yield supQ<^<f |B2,s| 
Op{h1). Consequently, we complete the proof of (a), 
(b) Since 



00 fc„ — 1 

II* =71 E E fcnA(.9);'fc„A(5)^il^(F),il^(J«)tK, 



2^ p 

iibnvk V ^ ^ 



£ fc„A(.9);^_,fc„A(.g);'_^.i^^(7p),i^^(>)^i^,'^ 
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we can decompose it as 
lit 

1 



ilpHYk„y 

=:IIit+Il2,t+Il3,t 
where 



J2 + J2 \^p,q)tKf'^^''intii''{j')t+Y.^(p^^)^(^-^?')^^ 

p,q:p/\q>kn 'pAq<k„ / P,'J=1 



i=(p-fc„+l)vl j = (i3-/c„+l)Vl 



When (p - fc„ + 1) V 1 < i < p - 1 and (9 - A:„ + 1) V 1 < j < g - 1, we have S' V < 5^-^ V T^-i < S'p V < 
^»+fe„ V f on {IP n J« 7^ 0}, hence we obtam 

lilt 

E E E ^■nA(.g)^_,fc„A(.9)«_^. + (fc„A(.g)J?)2Kf^ 



\-rni ,1, p^g.p^g>fe^ \i^(p_j,^_|_i)vl j = (g-fc„ + l)Vl 



g-1 _ _ \ 

E fc„A(.g)[?fc„A(5)^_,i^r + E fc„A(5)^_,fc„A(.g)[Ji^,^«j/?ril^(/f),il^(J«),. 



j = (g-fc„ + l)Vl i=(p-fe„+l)Vl 
= (D-fc„ + l)Vl 



Note that EII,=(i,-fc„+i)vi A(.g)"„^ = Et=o^ ^{9)^ = 5(1) " .9(0) =■ when u > fc„ and g is Lipschitz continuous, 



we have 



E A'riii^(/^)*ii^(>)ti<^ 

p,q:pAq>kn 



hence we obtain _E[supo<s<^ |IIi,s|] ^ ^ ^^^^ Doob inequality and [SC1]-[SC3]. Therefore, we conclude that 

sup \Ih,s\ ^ Op{bl/^). (6.10) 

0<s<t 

On the other hand, since g is Lipschitz continuous and (/^ n J'' ^ 0) ^ (|p — < 1) by Lemma 2.1(b), 
we have |Il2,t| < Ep=i l^^(^^)tP + J2g=i {J%? , hence the Doob inequality, [SC1]-[SC2] and (6.1) yield 
E [supo<s<t |Il2,i5|] ^ Therefore, we obtain 

sup \lh,s\^Op{bZ). (6.11) 

0<5<t 

Now we estimate Ils^t. Since 

00 /Cn —1 



"3,* = 7;r^r^ E E A:„A(g)^fc„A(g)^il^(?+^')il^(J^-+^)a^,-.+,n,,,,^0j, 
we can decompose it as 



^ 00 kn — l 

113.* =7—^ E E {(a'WTq + (5')p A2(5);' + A2(5);(5')^ + A2(5);A2(g);^} 
^ i,j=l p,q=^ 

xii^(?+f)*ii^(j^-+^)a^p+,^j.,+,^0j 

=:II«+Il(^)+II^^)+Ilg, 



where A2(5)» = /c„A(5)^ - (5')^ 
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Consider 113^^ first. Integration by parts yields 



X i<Y\i+p,j+q 



{/i+Pn,/3 + 9=0}' 



hence we obtain suPq<j<( IHs^] — M(2)"| = Op{b'^) by Lemma 6.3 and linearity of integration. 
Next we consider II3 {. Since K^^ = if |i — j\ > kn due to Lemma 2.1(b), we have 

fe„-i 



sup 1 11^^] I < , \ ,3 V sup 



p=0 



i+p 



sup 

0<s<t 



fc„-l 
q=0 



hence the Schwarz inequality and the Doob inequality yield 
E 



BUP 114^] I 

0<s<t 



'fc„-l 



1/2 



'fe„-l 



1/2 



<- 



Since |A^(g)J^| < fc~^ because of the piecewise Lipschitz continuity of 5', we obtain 

fc„ - 1 fe„ - 1 



sup |l4^]| 



0<s<t 



^ ^ E E +E E 



i p— 



J 9=0 



hence [SC1]-[SC3] imply that E supg^^^j jllg^]! < fc„^. Consequently, we conclude that supo<s<( |Il3^]| = 

Op(b\!'^). Similarly we can show supq<5<( |l4']| = Op{hl!^) and supo<s<t llla^ll = Op{bn'^), and thus we conclude 
that 



6-'^{Il3,. - M(2)"} ^ 0. 
Consequently, (6.10), (6.11) and (6.12) yield 

- M(2)"} ^ 



(6.12) 



(6.13) 



as ri — > 00. 

(c) Note that YJiZ{p-k^+i)\/i J2jZlq-k^+i)vi9p-iknM9)q-j = when p A q > fc„, we can adopt an argument 
similar to the proof of (b) . 

(d) Similar to the proof of (c). □ 
Proof of Lemma 4.2. The claim of Lemma 4.2 follows immediately from Lemma 6.2 and 6.4. □ 

7 Proof of Lemma 4.4 

By a localization procedure, we may assume that [SC1]-[SC3] instead of [C1]-[C3] respectively. 

We will follow the strategy used in [27] and [28]. Fix a t G R+ and let Af be the set of all square-integrable 
martingales orthogonal to {X^Y, , Z^) and satisfying bn^^'^(M." , N)t as n 00. Then A/" is a closed 
subset of the Hilbert space of all square-integrable martingales orthogonal to {X, Y, Z^ , Z^) by [Al*] and the 
Kunita-Watanabe inequality. 

Let N be in the set A/"" of all square-integrable martingales on orthogonal to {X,Y, Z^ , Z^). Then it is 
easy to check that {e^^,N) = {€^,N) = 0. Hence we have (M", iV) = because N is orthogonal to {X, Y, Z'^,Z^), 
so that N £ M. Consequently, we conclude that JV^ C JV. 

Let N be in the set Af^ of all square-integrable martingales having 



(7.1) 



where / is any bounded Borel function on R^'^, ti < ■ ■ ■ < tq and q > I. Then it is easy to check that N takes the 
following form (by convention to = and <q+i = 00): 



ti <t<ti+,^Nt = M{l;et„...,et,)t 
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for I = 0, . . . , q, and where M(Z; zi, . . . , zi) is a version of the martingale 



/(zi, . . . , z;, . . . , z,)Qt,^i (dz/+i) • • • Qt^idzq)\J't 



(0) 



(with obvious conventions when I = and I ~ q), which is measurable in (zi, . . . , z/, w*^ ''•'). In particular N has a 
locally finite variation, hence is a purely discontinuous local martingale because of Lemma 1-4.14 of [29] and 

s:0<s<t 
l:ti<t 

for any semimartingales V, W, a, (3 E ^ and t E IR+. Therefore, for any V G {X, 3^}, we have 



and note that the boundedness of N we also have 

l:ti<t 

Hence, the Schwarz inequality and (3.2) yield 



^ fc„-i 

r E ^9')k'Hi'^{fi+''=ti} 



k=0 



E 



iCX3 

E E^[i^"(^')*< 



1/2 



i:ti<t 1,4=1 



1/2 



E^ 



[ CX3 




E^ 









1/2 



fe„-i 



1/2 



[SC1]-[SC3] imply that EZi^ \V^{T)t 



E 



fc„-i 



< fc„. Moreover, since 

2 fc„-l 



A;=0 



=EE i(3')^t:pi{f.+^=t,}<fc«ii3'iiook 

J k=0 



t, I ! 



we conclude that 



Y [i^l^'.R(r)-.€^(i^)},iv]: 



Consequently, we obtain 



Y [K'l • {lc.{r)~ • A/^(i^)},iV]i = 0,(fc„) 

for any (L,a) e {(X,g), (£^,5'), (3^,g')} and (Af,/3) e {(r,g), (£^,5'), (3'',5')}- By symmetry we also obtain 

00 

Y [^-' • {MfiiJ')^ •L^{V)},N]t = 0.p{K) 

for any (L, a) e {(X,.9), (€^",5'), (3^,.9')} and (M, /3) e {(y, 5), (€^, g'), (3^, ff')}- Consequently, wc obtain 
[M",iV] = Op(fc^^) = Op(6y'*). Since (M", A^) is the predictable compensator of [M",iV] by Proposition 1-4.50 of 
[29], we conclude that N eAf. 

Since Af^ U A/"^ is a total subset of A^^, we conclude that A/" = TM^. This completes the proof of the lemma. 

□ 
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8 Proof of Lemma 4.5 



Exactly as in Section 6, we can use a localization procedure for the proof, and which allows us to replace the 
conditions [A4] and [N] by the following strengthened versions: 

[SA4] ^ V ^ < C' and (6.1) holds. 
[SN] We have [N], and the process (/ \z\^Qt{dz))t^R^ is bounded. Furthermore, for any A > there exists a positive 
constant Cx such that 



E 



for every i,j S {1, 2} and every t,h > 0. 



Proof of Lemma 4.5. By a localization procedure, we may assume that [SC1]-[SC3], [SA4], [SN] and (6.4) hold. 
Since Lemma 4.3 and Eq. 1-4.36 in [29] yield 



where X(J)* = Xg{I)l + and y{J)i = Yg{J)i + ii^,{J)l, it is sufficient to prove that 



^8 



E 



0<s<t 



US 



E 



0<s<t 



as n — ^ c» for any i > 0. Since 



fc„-i 



Tj + i=s} 



ij 9=0 



oo oo q 

^E4.i{f,.4E E (5')^,i^'|,x(i)i,„ 



9=1 



i=l j = (g-fc„ + l)Vl 



we have 



^ oo 

Ta E 



9=1 



E E (3')^,i^|,X(X)^, 

i=l j=((j-fc„+l)Vl 



because T'^ z^T'' if g 7^ q' . Moreover, since K"^^ = when \i — j| > fc„ due to Lemma 2.1(b), we have 



hence we obtain 



< 



9=1 



"f.) i{f.=4 E E 

J=(9-fc-^+l)vl^:|^-i|<fc„ 



T9 



= ll.9'l|oofc?. E E (' 



X(I) 



1 



{TJ + 9=s}' 



E 



5]i^:^x(i):A£^(i)i 



— 1 

< 11.9'iioofc^ E E 

ij:|i-il<fcn 9=0 



X(I) 



Ti + i/\t 



1 



{T3 + 9<t}- 



Therefore, the Schwarz inequality and [SN] yield 



En 



E 

0<s<t 



EA7X(I)^A£^(^)i 



^fc^ E eV° 

ij:|j-j|<A;„ 9=0 



1/2 



1 



{Ti + <!<i}- 



(8.1) 
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Now, the Burkholdcr-Davis-Gundy inequality and [SN] imply 



En 



p=0 



^{S'+P<t} 



<k: 



Combining this with (6.4) and [SC3], wc conclude that 



Eo 



and thus we obtain 



E 

0<s<t 



< 



kib-\KfMogbn\f = fc^5f ^i|log6„p, 



E 

0<s<t 



<62?'-i|log6„|2=o(l) 



because ^' > 9/10. Consequently, we have proved the first equation of (8.1). By symmetry we also obtain the 
second equation of (8.1), hence we complete the proof. □ 



9 Proof of Proposition 4.2 



Lemma 9.1. Let a,(3 e ^. 

(a) ipp^aix) = ipa.isi—x) for all x G M. 

(b) Va,/3(x) = 0/ora:^ [-2,2]. 

(c) Tpa,^ is dijferentiable, and ip^ p = ''Pa,p' "if P is piecewise . 

(d) Tpa.a is an even functions. Furthermore, Tpa.a' andipa',a o.fe odd functions if a is piecewise . 

Proof. Since {x + u— l<v<x + u + l)<i^ {—x + v — I < u < —x + v + I) and a{w) = I3{w) = ii w ^ [0? l]j 
Fubini's theorem yields (a), (b) and (c) are obvious, (d) immediately follows (a) and (b). □ 

Lemma 9.2. Let a, f3,a' , f3' G <f> and let (M"), (A^"), (A/'") and (A^'") be four sequences of locally square-integrable 
martingales such that 



(A/")t = Op(l), (iV"), - Op(l), (A/'"),-Op(l), (^'"), = Op(l) 



and 



supp^N(Af")(/P)t ^ 0^(61'), sup,eN(^")(^')t = Op{bt)^ 
supp^p,(M'")(/P)t = oM), sup,gN(iV'")(J«)t = oM) 

as n -> oo for any t G . Then, we have 



^ J2 (/^l^'i^-^'')-^a,/3;a',/3'(M",iV";M'",iV'")r^' 



and 



= E "^"'1^ 

oo 

lit = X! '^"./^ 



= E '^'"•'3 

CO 

p. 9=1 

as n OO /or any ^ G M+ . 



kn 

q-p 

kn 

q-p 
q-p 



q- p 

kn 

p-q 

kn 

p-q 
p-q 



{M^,N"'){TP)t{M'",N^){J%+Opibl/^) 
{M^,N"-){P)t{M'^,N^){F)t + Op(6y2) 
(M", 7V'")(>)t(A/'", A^")(>)t + Op(6y2) 



(9.1) 
(9.2) 



(9.3) 



22 



Proof. First note that K]^ ■' is a step function starting from at t = and jumps to +1 at t = [i V i', j V /) 
when /' n ^ 0,r' n J^' ^ and that y„,/3;a',/3' (A^", iV"; M'", A^'")r'^' = if t < R^'iiM V j'), so we have 

by integration by parts. Therefore, we have 



^T7 , ■/ 



+ (/!+^'J^'+«' • {M",N'")t){f+P'ji+^ • (A/'",7V")t)} 
+ (?^J!' • {M'',N"')t)iT^Jl • (M'",iV")t)} 



= :If+IIt. 

Since fp Ci fp' = > n J?' = if p 7^ p', q 7^ g', wc have 

00 

1*= E Ca,/3(p,QK.,;3'(p,g)(M",M'")(/P)t(iV",7V'")(>)t. 
p,q=l 

Moreover, since |ca,^(p, 9)!, |ca',/3'(p, (?)| < 1 and Ca,f}{p,q) = Ca\p'(j>,q) = if \p — q\ > 2kn due to Lemma 2.1(b), 
(9.2) and the Kunita-Watanabe inequahty imply that 

It = E c„,MP,9)ca',/^'fe'Z)(M",A/'")(?'')t(A^",A^'")(>)t+Op(6,V'), 

p,iy:p,Q>A:„ 
|p-g|<2fe„ 

hence Lemma 3.1, (9.1), (9.2) and the Kunita-Watanabe inequahty yield 

It - E (^) ^a',^' (^) (M",M'")(P),(iV",^'")(>), +0^(61/2). 

On the other hand, an argument similar to the above yields 

lit = £ ^a,/3 (^^) (M",7V'")(P H >' )* (A/'" , TV") (/"' H >)* + Op(6y2). 

Since n J'' = if |p - > 1 by Lemma 2.1(b), wc obtain 

= E E ^"'^ ( ) ( 

/ I / 1^1 / I / 1/1 \ f^ri / \ f^7i 

X (Af",iv'")(/p n j'^')t{M"\N''){Tp' n J9)t + Op(&y2)^ 

however, since i/Jq,^ and ipa'.p' are Lipschitz continuous, an argument similar to the above yield 



00 



',;3' 

p,q=l ^ ■"" ^ P':b'-9|<1 9':|9'-p|<l 



X (A/", A^'")(/P n J'j')t{M"\N"){IP' n J9)t + Op(6y2). 

Therefore, we conclude that 

ii,= f; (^)^.'.,' (^) (M",^'")(P),(M'",iv")(>),+op(6y2). 

In a similar manner we can show (9.3), and thus we complete the proof of the lemma. □ 
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Lemma 9.3. Let a G $ and let A" and be two processes with locally bounded variations such that 



A^ = Op{l), Br = Oj,(l), sup =Op(f„), sup|i?"(J9)t| =Op(f„) (9.4) 



as n —> oo for any t £ . Then 



p,q=l 



as n —> oo /or any t G IR+ . 
Proof. Lemma 9.1(b) yields 



p. 9=1 



a,« , ^ ) A"(F)ti?"(J«)t 



< |^r|sup|i?"(J')t| 



2fc„ 



Since ipg^gi {x)ipa^aix) is Lipschitz continuous, we have 

-r- E ^9,9' { ir] ^''^''^ { ^] = V'3,3'(a;)^a,a(a;)da; + ( 



however, V'g,g' (2^)V'a,a(2;)da; = because i/^g^g' is an odd function and ipa,a is an even function by Lemma 9.1. 
Combining this with (9.4), we obtain 



E '^S'f' 

p,q=l 



^^^co V^U"(/^)tB"(J')t 



< o, 



(5?'-^/^) = 0,(1) 



and thus we complete the proof of the lemma. □ 

Proof of Proposition 4.2. [B2], Lemma 9.2 and the fact that both ipg^g and i/'g'.g' ^.re even functions and tpg,g' 
is an odd function yield (M(/)")t = V^"'' + Op{bl/^) for / = 1,2,3,4 and (M(l)", M(2)")t = V^^'^^ + Op{bl/^), 
(M(3)", M(4)")t = Vt''^^ + Op{bl/^) asn^oo for any t e IR+. Moreover, by Lemma 9.2-9.3 we have 

(M(1)",M(3)"), = opiblp), (M(1)",M(4)"), = Op{bl/'), 
(M(2)",M(3)")i = opibl/'), (M(2)",M(4)")t = Op{blP) 



as n ^ CX3 for any t € IR+. Consequently, we obtain the desired result. 



□ 



10 Proof of Lemma 4.6 

Before starting the proof, we strengthen the condition [A3] as follows: 

[SA3] For each V,W — X, Y, , , [V, W\ is absolutely continuous with a cadlag bounded derivative adapted to 
H", and for any A > there exists a positive constant C\ such that 

for any bounded F'^^-stopping times t\ and ti-, for the density process / = [y, VF]'. 
First we prove some lemmas. 
Lemma 10.1. is -measurable and is W-,. -measurable for every k. 

Proof. For any i > we have {S"^ < t} = f]^[{S' <t,S'< S''} U {S'' < S'}]. Since {S' <t,S'< S''},{S'' < 
S^} £ "H^j. for every fc, we obtain the desired result. Similarly we can show that T*"' is "H-^, -measurable. □ 

The following lemma is a version of Lemma 2.3 of Fukasawa [17]: 
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Lemma 10.2. Suppose that for each n G N we have a sequence {tJ}) of H""- stopping times and a sequence (i^^) of 
random variables such that i^J^ is adapted to "H^n for every k. Let p > 1 and t >0, and set 7V(r)" = X]fc°=i l{T^<t}- 

(a) IfJ2k=i''^^ E [|C^|2^''|-H;^„ J ->p as n ^ oo, then J2k=i"^^ {Q ~ E [Cfe [K,- J } as n ^ oo. 

(b) IfbnN{T)'i = Op(l) asn^oo and &„ Efii^"^^ E |C?|''|'H","_, = Op{l) asn^oo, then 

W(r);' + 1 

fc=i 



as 71 oo. 



Proof. Let m ^ 2 A p and let T be a bounded stopping time with respect to the filtration Then, the 

Burkholder-Davis-Gundy inequality and the Cp-inequality yield 



E 



k=l 



-E 



1 

} <CE Y.{\Q 



E 



cm- 



.k=l 



'} 



for some positive constant C independent of n. Since E 



stopping theorem and 



E 



T 



< E 



ICrl^l^r" t)y the Holder inequality, we obtain 



by the optional 



k-i 

m-. 



E 



aiK,"_J} <2CE j2E[\Qr\n-._^ 



Lk=l 



Therefore, note that N{t)^ + 1 is a stopping time with respect to the filtration ("H",!), (a) holds due to the Lenglart 
inequality. On the other hand, since 



k=l 



k=l 



by the Holder inequality, (b) holds due to the Lenglart inequality and the fact that m > 1. 

For a cadlag function x on and an interval / C K+, set w{x; I) ~ sup^^j |a:^('S)|. Moreover, define 



□ 



6, T) = inf < max w(a;; t;)) |0 = t^ < ■ ■ ■ < tr = T, inf (t^ — ti_i) > S> 

I i<r i<r J 



for each S,T > 0. 



Lemma 10.3. Let {xn)n<£S.+ be a sequence of cadlag functions on IR+ which converges a cddldg function x on R_)_ 
for the Skorokhod topology. Let t be a positive number. Suppose that for each n G N there are points s" such that 
— Sq < Si < ■ ■ ■ < s]^ — t and supj(s" — s"_j) — ?• as n —)• oo. Then we have 



^x„(sr_i)(sr-sr_i)^ / x{s)ds 



as n —> OO . 

Proof. Since a;„(s)ds — ?► /J x(s)ds as n — ?• oo by the bounded convergence theorem, it is sufficient to show that 

(10.1) 



^ X„(sr_i)(sr - SU) - / ^n{s)ds ^ 

as n — > oo. Take > arbitrarily. Since lim54^o sup„gj^ z/;'(a;„; 5, t) = by Theorem VI-1.5 of [29], we can take a 
positive number (5 > such that sup„gpj w'[xn',5, t) < r]. Then there exist points ^" such that ~ Q < < ■ ■ ■ < 
6J?i„ = infi<m„(C - CP-i) > ^ and that max„g{o,...,^i„ _i} ^^Pseie^,^!;^^,} \xn{s) - 2:„(^;\)| < 77, and we have 

^a;„(sr_i)(s^-sr_i)- / a;„(s)ds < XI / W{s^,_y) - x^{s)\As < r^t + m^fiyx^{s'l - s'l_^) . 
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Since m„ <t/5 +1 by infi<m^(^" — CP-i) ^ '^e obtain 

K. 



lim sup 



Since 77 is arbitrary, we conclude that (10.1) holds, and thus wc complete the proof of the lemma. 
The following lemma is a version of Lemma 2.2 of Hayashi et al. [20]. 



□ 



Lemma 10.4. Suppose that [Al'](i)-(ii) holds. Suppose also that there are a sequence (_ff")„gi{+ of cadldg H"- 

^ ^ Sk.p. 

adapted processes and a cadldg process H such that ff" — H as n —> 00 . Then we have 

N" + l 



k=l 

as n 00 for any t £ IR+. In particular it holds that hnN^ — >p cp~ds as n —>■ 00 for any t G 
Proof. First we show that [C3] holds. Take a positive number L arbitrarily. Then we have 



E 



<E 



{fl^<t,G(l)",<L,G",>L-i,#Af,7<L} 



E 



00 

T^i{i?''<t,G(l)J,<L,G^,>L-i,#A/-„"<L} 
.fe=l R'^ 



f.G(l)^ 



.k=i R" 



Qu^ -{R''<t-G{l)l^<L,Gl^>L~^} 



L = b-^E 



°° |pfe+l 



E 



.k=i R" 



Qn_ l{i?''<t,G(l)^,<L,GJ,>L~i} 





00 






<Lb-^E 


E |r''"^^|i{fl'=<t,G(i)^,<L} 


+ L<Lb-'i^E 


Eirl 




.fe=i 




k=l 


<Lb-h + 


L^ + L. 







E 



|r""+^|i{G(i)" „<L} 



+ L 



L 



On the other hand, since 



M < t,G(l)'^. < L,GS. > L~\#Af^ < LY] c ( sup G(l)^ > U ( inf < L'A U {#AC? > L}, 

i~i l0<s<t J LO<s<t J 

G(l)r < {Gipm'^P 



note that 

by the Holder inequality, [Al'](i)-(ii) yield 

lim sup lim sup P I Q [{R'' < t,G(l)^. < L,G^. > L-\#J\f^' < Ly]] = 



(10.2) 



L— foo n— >oo 



Consequently, we obtain [C3]. 



Next, since [Al'](i)-(u) and [C3] imply that 6„^^|+^ " E [(^-^ Ir'^'l)" \W^,-^] ^ Op(l), Lemma 10.2(b) 



H" 



yields bnY^kli^ {^rT^|r''| - G(l)J,_i} = Op(l). Therefore, note that the fact that (#7V°)„eN is tight, we 



conclude that 



fc=l 

as n — 00. Since Lemma 10.3 implies that 

7V" + 1 



6„ E E 7.7#^|r1^''o 

k=i ^y^'R"-^ 



Tjn 



G*., 



-ds 



as n — 00, we complete the proof. 



□ 
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Proof of Lemma 4.6. By a localization procedure, we may assume that [SA3] and [SC2] hold instead of [A3] and 
[C2] respectively. Recall that for a function a on R we write = a{p/kn) for each n g N and p g Z. 

(a) Without loss of generality, we may assume that 0(1)" — >■ G a.s. as n — )- oo in B(]R+). First we show that 

oo oo 

E \(^9,9y^-p\'mint[Y]{H = E i(^s..)^pi'wa")*m(r'')t +o,(fe,\/2). (lo.s) 

p,<j=l P,9=l 

We have 

oo 

oo 
oo 

Therefore, [SA3], [A4] and the fact that ipg^g is Lipschitz continuous and equal to outside [—2, 2] by Lemma 9.1(b) 
imply the desired claim. By symmetry, we also obtain 

oo oo 

E li^a-.^r.-pmiintiYKH^ E i('/'.,.)^pn^](r^)*[y](r^)t+op(^'y'), (10.4) 

p. 9=1 P,9=l 

hence wc have 



E iW'9,.)^-pPm(/^)*m(>)t 



.,9=1 



E l(^.,.)^pPW(r^)*m(r')t+ E l(V^.,.)^pPm(r^)tm(r')t + op(&y^). 



p.q:p<q 



p,q:p>q 



Consider the first term of the right hand of the above equation. Let w„ — (i+l)Ainf{s|r„(s) > r„}, R*' — /\v„ 
and r'^ = [i?*^"^, i?*^). Then obviously Vn is F^^^-stopping time and sup^. |r'^(t)| < 2f„. Therefore, we have 



E 



< 



E 



for any A > by the Schwarz inequality and [SA3]. Hence we obtain 



At 



du < hi 



Em(nt E i(V'9..)^piMm(r'^)t-m'fl.-ir'(i)i} 

p— 1 q:p<q 
oo 

Emin* E i(^..9)9-pi'^[lm(r')*-[>^]k.-Ajrnoi 



:vr,.>t 



.p=l g:p<g 

oo 



Em(r^)* E K^s^ 



n |2 
S-'q-pl 



Lp=i q-p<q 

by Lemma 9.1(b). Since P(u„ < i) — > as 71 — > oo by [A4], we conclude that 



E \{i^a,9)q^p\'[x]irnt[Y]iT%= E l(^.,.)^pl'm(r^)t[>^]k.-|rnOI + op(&y')- (io.5) 



p,q:p<q 

Next, [SCI] yields 



p,q:p<q 



E l(^.,.)^pn^](ntMK.-i {|rni)l - |r''|i{«,-.<,}} 



p,q:p<q 



<El('/'«.«)^r+i-pHr"WI|r'^"^'l 
p=i 
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Take L > arbitrarily. Then, we have 



N" 



El(^s^f)V+i-pl'|r'W|G(l)r;G(l)r < L 



<2knbl/^yjgJ^LE[r„it)] 



by Lemma 9.1(b). Since E[rn(t)] — > as 71 — > oo by the bounded convergence theorem, for any 77 > we obtain 
hmsup„P(6-^/'E^"il(V's.s)^.+i_pP|rf(t)||r^"+i| > v) < hmsup„P(G(l)r > L). Since (10.2) and [Al'](ii) 
imply that hmsup„ P(G(1)" > L) — > as L — > 00, we conclude that 

and thus wc obtain 

E l(^.,.)^pPW(r^)*mk.-|r'(OI= E l(V^.,.)^pPm(ntr]k.-|r'|i{fl.-<t} + op(^y')- (10-6) 

p.q:p<q Pq-P<q 

On the other hand, [SCI], [SC3] and Lemma 9.1(b) yield 



E 

g=2 



b'j' E \i^,,,)q-pnxKni 

p:p<q 



E 



(6-i|r?|)^|H^,„, l{fl.-i<t} < 6-V„(i)^ sup G(n7)^, 

-I 0<s<t 



where zu = 2 A p. Hence [Al'](ii), the Holder inequality, (2.3) and the fact that w£,' > 1 wc obtain 



E 

9=2 



E \iMq-p\'min^ 



p:p<q 



E 



l{_R'!-i<t} 



(10.7) 



as 72 00. Therefore, Lemma 10.2(a) yields 

E \{^q,a)^-pm{nt[Y]'n.-i\nMR^-^<t} = bn E i(V's,.)^pi'm(r^)tmk.-iG(i)^,_a{«,-i<t} 

p,q:p<q P,q-p<q 

+op{bT). 

and thus [Al'](i)-(ii), (10.2), [SCI], (2.3) and Lemma 9.1(b) imply that 

E l(V',,,)^-,l'[^](r»')t[r]^,_,|r«|i{;,,-i<,j 

p,q:p<q 

E i(^5.s);-pn^](r'')t[>^]k.-G»,-a{H.-^<n+op(&r/')- 

Now we show that 

bn E l(V'^,9)^pl'm(^^)tmH.-lGS,-a{fl^,-l<^} 

00 

=6„EW(r")*Mfl-iG^-i E \i^9.9)q^p\'kR^-^<t}+Opibl/')- (10.8) 

p=l <j:p<9 

We have lim^^o sup„gN w'(F"; (5, T) = a.s. for any T > by Theorem VI-1.5 of [29], where F" = [Y]'G'\ 
Therefore, for any 77 > we can take a positive (random) number S such that a.s. sup^^^jw' {F""; 5,t) < rj. Then 
we can take (random) points such that = < ^" < • • • < = t, infi<m„(Ci" ~ C?-i) > ^ and that 
max„<™„u;(P";[C-i,0) Let S" = = 1, . . . , 777„}. Then" 



bi/' 



<bi/^J2^X]{Tnt E l(^.,.)^pl'- 277 + 61/2 ^[X](r^'), ^ |(^^^^)^_^|2.2(F"):, 
P=i q-p<q pgi" q-p<q 
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where I" = {p G N\[Rp, Rp+^''") n S" 7^ 0} and (F")* = sup„gN sup,g[o,t] due to Lemma 9.1(b). Hence there 
exits a positive constant C such that 



P=i q-p<q 



<C|t.2ry + 2(F"):^|rf(t)| 

pel" 



by [SCI] and Lemma 9.1(b). Now [Al'](i) implies that sup„gpj(i^")j < 00, while m„ < t/6 + 1 because inli<,j^^(^^ 
^JLi) > 5. Moreover, for sufficiently large n we have #1" < Akn'fhn, and thus we obtain 



lim sup 6,y ^ 



P=i q-p<q 



< 2CtT] 



by [A4]. Since t] is arbitrary, we conclude that Eq. (10.8) holds. On the other hand, since 



bn 



{Rp-^<t<Ri- 



p=l 



q:p<q 



<6„ sup g: J2 E i(V'9,.)^pi' - o,(f„) = op(6y2), 



0<s<t 



q:p<q 



we have 



p^l g:p<<? 

00 

=6„5][x](rp),[r]'^,_,G^,_, ^ l(^s,s)^pl'i{«-i<t} + op(&y')- 



p=l 9:p<9 

Therefore, by an argument similar to the above we obtain 



p=i 



q:p<q 



=&nEw«-^[^]«-^ iG^,,-,i'i{fl.-i<,} 5] i(^,,,)^,p + op(6y2). 



q:p<q 



Consequently, we obtain 

E \{y^a,a)q-pmint[Y]int 



p,q:p<q 



=&^EWfi-^[^]fl''-|G«.-l'l{«-^<t} E \ii'q.q)q-P? + Op{h]I^) 



p=i 



q:p<q 



=bTe /%,,,(x)2dxf;m'^,_,[y]'^,_,|G'^,-,pl{^,-,<,j+Op(6i/2) 

=bl/'e f\g.g{xfdx f\xUYlGsds + Op{bl/') 
Jo Jo 

due to Lemma 10.4. By symmetry we also obtain 

P,q:p>q "^"^ 

After all, we complete the proof of (a) . 
(b) Similar to the proof of (a). 



(10.9) 
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(c) Since < and < \ik <l and V = by Lemma 2.1, we can rewrite the target quantity as 

^4 lives', g'ig-pl *5P ^rg-^{SPVT9<t} 

" p,q=l 

oo oo 
oo 



' T<J {T<!<t} IV^S ,5 ;q-pl »^ 5p I Sp {Si'<t} wrg ,g Jq-p\ ^ rp^ 

" q=2 p:p<q " p=2 1'<1<P 

oo 



fc=i 

Note that 4* is cadlag, by an argument similar to the above we obtain 

oo oo Q—^ 

" 9=2 p:p<g " g=2fc„+l p=q~2k„ 



g=2fc„+l 

Note that 6„ = ^'i I^feli + Op(6„), Lemma 10.4 yields 



-Lgv,-! ^ |(^^,^,)n_^|2^n ^^1/2^-3 /%^,^,(,)2d, /^ii.I.fG7M,s + 0,(61/2). 

9=2 p:p<9 -^0 -^0 

By symmetry we also obtain 

'^n n-,7^n •'—2 ./O 



p=2 q-q<p 



Since *|l*Pc Opih'^), we conclude that 

p,,= l 1 - / Jo 

(d) First, Proposition 2.1(a), [SC2]-[SC3], Lemma 9.1(b) and an argument similar to the proof of (10.8) imply 
that 

-j^ oo 

Ta E \^^9' ,9')q-p\ ^ SP^{SP=fv<t}^ fi^{St=fi<t} 
" P,9=l 

^"P" E l(^9^9')9-pl^*i^^p-l-'-{Sp=fp}*/?Vll{s■J=f<I}l{flI'^''-l<t} +''p(^y^)- 

p,q:p=jtq 

On the other hand, note that < Ijjfc^f^fcj < 1, by an argument similar to that in the proof of (a) we can show 
that 

^ oo 

p:E E l(■'^^^9')9-pl^*HVll{5P=fp}*fl9-ll{S9=f9}l{fl''~^<t} 

" 9=2 p:p<q 
^ oo 

= fc4E E KV^.'-.O^pP W-x'«VO'i{«-^<n + «p(^y') 

^ 9=2 p:p<q 

using [SC2] and [Al'](iii) instead of [SCI] and [Al'](i) respectively. By symmetry we also obtain 

^ oo 

^E E \('^9' ,g')q~p\'^'^Rp-^^{SP=fi'}'^Ri-^^{Si=fi}^{R'''^<t} 
" p=2 q:q<p 

=fE E i('/'.'..')9-piM*«-^xS-0' +op(^y')- 

" p=2 q:q<p 
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Therefore, Lemma 10.4 yields desired result. 

(e) By an argument similar to the proof of (10.3), we can show 



p,q—l 



{T.<t} ^2 



oo 



.,9=1 



On the other hand, we have 



1 



" p:flP-l<t<flP+2'=Ti 9:|9-Pl<2fc„ 



>t}' 



hence by [A4] and [SCI] we obtain 

1 



Op(r„) 



Therefore, we conclude that 

oo oo CX) 



jL2 



" p=l q=l 

hence, note that ^ is cadlag, an argument similar to the proof of (10.8) yields 

oo oo p+2fc,^ 



2,2 

" p,g=l 



" p=2*;„ + l 



g=p-2fc„ 



Jo 

This completes the proof of (e) . 

(f) Similar to the proof of (e). 

(g) An argument similar to that in the proof of (e) and the fact that ^ is cadlag yield 

oo oo 

:^ E l(^9.s')^pn^,>^](?'^)t«']|.i{s.=f.<n=i:j E l('/'9,s')^pl'[^,i"](?~^)t^flVa^s,^f,j + op(6y2). 



1.2 



p,q=l 



Therefore, we can show the desired result by an argument similar to the proof of (a), 
(h) Wc decompose the target quantity as 



E \ii^a',a');~p\'iz'']int[z'']iJ'') 



p,<i--\p-q\<i p,9:p<9-i p,q-q<p-i 



1 /2 

Evidently Bi = Op{bn ). On the other hand, an argument similar to the proof of (10.5) yields 

B2 - E i(V'.',.')^pn^'^"](/^)t[^'']k.-Aj'^'wi +op(&y')- 

p,q:p<q-l 

Hence, note that | J'^'j is "H^^^ -measurable for every k due to Lemma 10.1, by an argument similar to the proof of 
(10.7) we obtain 

B2 = 6„ E l(V^ff',ff')g-pl'[^''](^^)*[^'']k.-^|.-l{fl'-<t} + Op{bl/') 
p,q:p<q-l 

and, by arguments similar to those in the proofs of (10.8) and (10.9), we conclude that 



p=2 q:p<q-l 



q-p\ 
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Therefore, Lemma 10.4 yields 

Jo Jo 



By symmetry wc also obtain 

J-2 Jo 

Note that b~^/k^ — )■ 9~'^ as n cx), we complete the proof of (h). 
(i) An argument similar to the proof of (10.4) yields 

OO CXD 

E l('/'.'..')^pn3^,3nU^)t[3^,3n(J«)t= E l(V'.',.')^pn3^,3^](r''),[3^,3^](r')t + Op(6y^). 

p,q=l p.q=i 

Since [5^,5^]iT'') = {I'lP + P+^P + i'iJ^+^) • [Z^,Z^], note that j/'^ n P\ + n + \l'' n J'^'+ij is 
H^fc -measurable for every k due to Lemma 10.1, by an argument similar to the proof of (a) wc complete the proof 
of(i). 

(j) An argument similar to the proof of (c) yields 

OO CXD p+2fe„ 

" p,9=l " q=2k„ + l q=p-2k„ 

=6y20-i^;E*]^,-.[zn(j'), + o,(6y2). 

9=1 

Therefore, note that ^E*^^ is H"-adaptcd, combining Lemma 10.4 with arguments similar to those in the proof of 
(10.5) and (10.7), we conclude that 

and thus wc complete the proof of (j). 
(k) Similar to the proof of (j). 

(1) An argument similar to the proof of (10.3) yields 

OO OO 

E \i^,^,')'^.,nx]{H[z'']{j%^ E i(^.,s')^ppm(rp)*[^''](j^^)*+op(&y')- 

p,q=l P,«=l 

Hence, the desired result can be shown in a similar manner to the proof of (h). 
(m) Similar to the proof of (1). 

(n)-(r) Similar to the proof of (h) (note that J^^ ipgi ^gi {x)^g^g{x)dx = k due to integration by parts and Lemma 
9.1). 

(s) Similar to the proof of (i). □ 



11 Proof of Proposition 4.4 

First note that an argument similar to the one in the first part of Section 12 of [24] allows us to assume that 
(6.1), ^ < C < C < 1 and S'^ are G(")-stopping times for every k under [A2] and [A4] (note that 5^ f'= 
and automatically become G'-"^-stopping times under [A2]). Furthermore, in the following we only consider 
sufficiently large n such that 

knTn < bi~^'\ (11.1) 

Lemma 11.1. Suppose that [A2] and [SA4] are satisfied. Let i,j G Z+ and let r be a G^^^'^ -stopping time. Then 
for any A <E ^i"' we have 

An{T< i?^(i + fc„,j + fc„)} n {Pir) n J^(t) ^ 0} e J-«a(,,j). 
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Proof. Let 

B = {t< R^ii + k,,,j + fc„)} , c = {r{r) n J^(t) ^ 0} . 
It is sufficient to show that A n i? n C n D G J\i for any u G M+; where D = {R^{i,j) < u}. On C we have 
+ K,J + kn) - R'^ii,]) < \P\ V I J^l V (5^+^" - f V (f - S') < Kfr,, 

hence 

R'^ii + + fcn) = {R^{^ + kn,j + K) - R'^ihj)} + R'^ihj) < + fc„r„, 

and thus we have 

cnD^cnDn + fc„, j + fc„) < u + fc„f„}. 



Since ^ € ^^"^ and C G , we have {Ar\C)r\B eQ 



.in) 



(n) 



Therefore, we obtain 



Ac^Br\Cc^ {R'-'ii + fc„, j + <u + fc„f„} e ^^„+fc„r„ 



however, Q^^^ f ~ 5-- (H-l)- This together with the fact that {R^{i,j) < u} e J-u implies 

AnBnCnDej:^. □ 

Lemma 11.2. Suppose that [A2] and [SA4] are satisfied. Let Z = (■Z^t)tGR+ &e a G^"'^ -adapted process. Let 
i,j G p,q & {0, 1, . . . , fc„ — 1} and Ze< t be a G^''^'' -stopping time. Then both K]^_I'^^ Z^- and A'^-L J^^'^Z,- are 
J-jlA ( j -measurable. 

Proof. On {r(r) n JJ(r) 
measurable set B wc have 



0} U {r > R^{i + kn,j + /fc„)} we have K\^_%^J' = 0. Therefore, for any Borel 



{KlUl+J'Zr e 5} = [{0 e B} n ({/^(r) n J^{t) = 0} U {r > + J + fc„)})] 



n 



e 5} n {l\t) n j^(t) ^ 0} n {r < + + fc„)} 



so we obtain {K]^_Tj^ Zr £ B} e J^Fi.^(i,j) by Lemma 11.1 because K^^JL'^Z^ is t/T--measurable by construction 



By symmetry we can also show that K^^_Jl^'' Zr is tJr-measurable. 



□ 



In the remainder of this section, we fix a, /?,«',/?' e $. Let Sf''^' := jt^Tto Pq K]^ K Jl"''^ Jl and 



A!' 



" ' = Ep",=o </3,"^t'^t ' for each t e M+. 

We introduce an auxiliary condition. 

[H] For each n G N we have four square- integrable martingales M", A^", M'" and A^'" satisfying the following 
conditions: 

(i) There exists a positive constant C such that 



E 



E 



E 



E 



< Cf 



for any t £ M+, n e N and i,j G N. 
(ii) For each n g N we have 



(M",A/'") ^ H{1)D{1)" • B{iy\ {N'\N'") = H{2)D{2)" • B{2y\ 
(M", A^'") = H{3)D{3)" • B{3)" , {M'",N") ^ H{4)D{iy' • B(4)", 

where is a cadlag bounded F^^^-adapted process, D[kY^ is a bounded G(")-adapted process and 

B{k)"- is a deterministic nondecreasing process or a G*^"^-adapted point process for each k G {1, 2, 3, 4}. 
(iii) For any A > 0, we have a positive constant Kx satisfying 



max sup E[\H(k),- H{k)(,_h-^ \'^\F(^s-h)^]<Kxh 

fee{l,2,3,4} o<s<t 



1-A 



for any t,h > 0. 
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(iv) For each T E M+ there is a positive constant Ct such that maxj-g^i 2,3.4} B{k)'^ < Ct ior all n. Moreover, 
there exits a positive constant C such that 

B{ir{iP)t V B{2riJ'')t V i3(3)"(F)t V B(3)"(J')t V i?(4)"(/P)t V i?(4)"(J«)t < Cf„ 

for any p, q,n €z N and any i > 0. 
For simplicity of notation, set 

for each € N when we assume the condition [H]. In addition, for an F-adaptcd process Z, we write Zt := 

Z^^_j^i-i/2^ . Then Zt is clearly G'-"''-adapted. 

Lemma 11.3. Suppose that [A2], [SA4] anrf [H] hold. Let r, s G IR+ and ,j' ,k,l,k' ,1' <E'L^. 
(a) For \i-k\>kn- I, \i' -k\> k^ - 1, \i - k'\ > fc„ - 1 and \i' - k'\ > fc„ - 1, 

/•t ft 



E 



S';^j:''E';'^''']Vr;yi^^H(2)^D{2y^H{2)^D{2)'^dB{2)'^dB{2y; 



(b) For \i-k\>kn- 1, \i - l'\ > fc„ - 1, \j' - k\ > k,, ~ 1 and \j' - l'\ > A:„ - 1, 



= 0. 



Proof, (a) Without loss of generality, we may assume that i > i' \/ k V k' , so we have i > k V k' + kn — 1- Since 
5(2)" is a deterministic nondecreasing process or a G'-"^-adapted point process, it is sufficient to show that 



E 



= 



(11.2) 



for any bounded G("^-stopping times ct, t. Lemma 11.2 implies that .=,^1"' H{2)^D{2)]^l[„^tj is J^BA(i' 
measurable and 'E.f^ ' iJ(2)^£'(2)"l{T-<j} is J^jjai-j.^^./ ;/^;/)-measurable. Moreover, M^''' is J^^fcvfc'+fc„-i-nieasurable 
by definition. Since j A f) < S' and R^^k Ak'jA V) < S'' < S\ we obtain 



E 

--E 



■^iji' j' ■:^klk' I' n/rii' n jkk' 



K'- ' m:_m::': i/(2)^i?(2)';i/(2)^i?(2);'i{,vr<n 



'^'ji^'E';'':'''M^'::im^D{2)^im 



Since M" is a martingale by the definition, the optional sampling theorem provides 



E 



limi; 

i5^0 



limMf.^, =0, 



which concludes the proof of (a), 
(b) Similar to the proof of (a). 

Lemma 11.4. Suppose that [A2], [SA4] and [H] are satisfied. Let t G IR.+ . Then: 

(a) There is a positive constant C such that 



fEfy'AB{2):<Ckt J2 fK''''dBi2)-<CfX 



□ 



(b) There is a positive constant C such that 



5^ fkrydBi^Tsi^cki tA'^y'dBiA):<cf„kt. 

i, i ,/ "'0 , Jo 
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Proof. Since ^ we have E^,^',J,f ^ K Eg.^io H-'' ■ Therefore, we obtain 



by [H](iv). 

On the other hand, since 



fc„-i 



fc„-i 



we have 



k„-l 



fe„-l 



Y j Sf ^'dB(2): < fc„ EE / i^?-if^'^it+'^'di3(2):<fc,2, £^i^,^^i?(2)"(J^+^), 

because Y.j' Jl-'' J'i-''' < H-'^ and A'^i < A^^ for s e [0,t]. Therefore, we obtain Y.e,j.r Iq^T'^' dB{2)'^ < f„k^ 
due to [H](iv). Consequently, we complete the proof of (a). Similarly wc can also prove (b). □ 

Lemma 11.5. Suppose that [A2], [SA4] and [H] are satisfied. Let r e [2,4]. 



(a) There exists a positive constant Cr such that E 

(b) There exists a positive constant C'^ such that E 



< CriknTnY for any t E R_|_ and any i,i' G N. 

< C'^{knfnY for any t G IR.+ and any i,j G N. 



Proof, (a) First, since {M2{Ty)t = Ep=o ("p)^(^^">(-^'^'')t' have {M2{Ty)t < A:„f„. Similarly we can show 
(Af^"(Z)* )t < knfn- Therefore, by the Kunita-Watanabe inequality we obtain 



E 



< 



Next, the Burkholder-Davis-Gundy inequality and [H](i) yield 



E 



2r 



<E \ EK)'[^n(?+^)t l-Fg. 

<{knfnr. 



fe„-l 



p=0 



Similarly we can also show E 



M^iiy 



E 



< 



{knfnY ■ Therefore, by the Schwarz inequality wc obtain 



M2{xyM'^{iy 



< 



[knTn) 



Consequently, we complete the proof of (a), 
(b) Similar to the proof of (a). 

Lemma 11.6. Suppose [A2], [SA4] and [H]. Then we have 

6-1/2 ^ (i^l^A'^^■').(Z:^;^(M^A^»),Z::(^,(^f'",A^'")), 

=6-1/2 ^ (K^K'=').v:^^^i,^^,(M\N--M'-,N'-y+o,(k^ 

as n oo for every t G K_|_ . 

Proof. We decompose the target quantity as 

= Ai,t + A2,t+A3,f+A4,t, 



□ 
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where 



A3,t= Yl iK'yK^^')'i{miy-N'jKjy:}'{Nj,^{j^^ 

- Y {K^yKi^')'m2{iy,N'^'{jy')-'m^^ 
A4,*= Y iK'^K^^')'i{Nj,'{jy-KKiy-}'miy.N^^^ 

- Y iK'yKi^')'{{N^{jy,M-'{iy)-'{miy,N'f^^ 

Consider Ai_t first. By the use of associativity and linearity of integration, we can rewrite Ai.t as 
Moreover, we have 

q,q'=0 
q,q'=0 

hence we obtain 




Let Tit := H{2)t - H{2)^. Then we have (Ai,t)2 = I + II + III + IV, where 
^= Y H I I ^'^-''^l-^' MtM^^mi),D{2)'lH^ 

11= ^ Y f f '^fy''^^-'^' MiiM^^m2)^^^^ 

k,k' ,1,1' •'^ -^0 

111= ^ Y I I K'-''^r-'^'M';^M^-T^sD{2)'^H{2)^D{2y^ 

IV = ^ Y I I K-^'^r-'^'MtM^^nsD{2)'^nrD{2y;dB{2y^dB{2)'^^ 

k,k' ,l,V ■''^ "^O 
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The condition [H](ii) and the Schwarz inequality yield 



I III 



< 



1/2 



< 



|S:^-'|dS(2) 

hence by Lemma 11.4(a) and the Schwarz inequality we obtain 



E 



2 f\^^y'\\M:-\'dB{2yA ( ^|s,^^^''''ll7^.|'di?(2)," 



1/2 



E 



7yi'j"||fl,f"'|2 



iiMr_i^di?(2)^ 







^ r|sJ:L^'''||7e.pds(2):; 



k,k',l,l 



1/2 



By the Schwarz inequality and Lemma 11.4(a) we have 

2' 



E 



<E 



E , 



||Mr_|^di3(2)^ 



^ |*isf^'idi3(2):H j ^ y'*isf^'iiM:!:|4dB(2)^ 



5] r|sf^'||M]!:|4di?(2)^ 



Moreover, since i3(2)" is a deterministic nondecreasing process or a G'^'^^-adapted point process, by Lemma 11.2 
we have 



E 



^iji f W l\,rii' |4 



\\M:_\'dBi2): 



u Jo 



= E 



E 



, / "'0 



hence by Lemma 11.5(a) and Lemma 11.4(a) we obtain 



E 



J2 ^*is;^'^'pepdi?(2): 



^ fc„(fcn?'n) 



On the other hand, since i?(2)" is a deterministic nondecreasing process or a G^^'-adapted point process, by Lemma 
11.2 we obtain 



E 



k,k',Ll 



/ \^r-'''\\T^r\''dB{2)'^ 



, Jo 



E 



E 

k.k'Ll 



, Jo 



and thus [H](iii) and Lemma 11.4(a) yield 

E 



E 



k,k'l.l 



-klk'l' 



mr\'dB{2)l 



, Jo 



|7^.Ha^") dB(2);? 



for any A > 0. Consequently, we conclude that < {knrn)'^bn ^ ^ fc^, and thus we obtain 

Since ^' > ^ > 9/10 and A > can be taken arbitrarily small, we conclude that b^^ll ~ Op{kf^). In a similar 
manner, we can show that b~^IH = Op{k^) and b~^TV = Op{k^). 
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Next, we evaluate E[I]. In light of Lemma 11.3(a), the terms contribute to the sum only when |i — fc|A|i' — /s| < fc„ 
or |i — fc'l A |i' — /s'l < fc„. Therefore, [H](ii) and the Schwarz inequality yield 

\m\ 



< 



E i 

Jii'i^i^' I i^i' ,k,k' i.i' .k.k' i.i' .k.k' i,t ,k,k' 

l,|i-fe|<fe„ |i'-fe|<fe„ |i-fe'|<fc„ |i'-fc'|<fc„. 

= :Ai + A2 + A3 + A4. 

Consider Ai. We rewrite it as 



E 



Jo 



iT^iji' j' 7:klk' I' Tijii' iiyfii' 



M';_M';_\dB{2)'^dB{2)l 



Ai= E ^ 

i.k:\i — k\<kn 



Then by the Schwarz inequality and the inequality of arithmetic and geometric means we obtain 



Ai < 



E 



Therefore, by the Schwarz inequality and the second inequality of Lemma 11.4(a) we obtain 

Ai < knf„kf^E 

Since i?(2)" is a deterministic nondccreasing process or a G'^"^-adaptcd point process, by Lemma 11.2 we have 



/ |sf'^"'pfr-pdi?(2)^ 



E 



E 



l"^]^']' II A/r«i' |2 



Af[LrdB(2)', 



E 



E 



\E 



di?(2): 



hence by Lemma 11.5(a) and Lemma 11.4(a) we obtain Ai < knrnk^{knrn)^ = k^{knrn)^ . Similarly we can also 
show that Ai < fc^(fc„f„)'^ for I e {2,3,4}. Consequently, we have \E[I]\ < fc^(A:„f„)'^, so that we conclude that 

b-^\E[I]\ = o{kl) because b-Hk^f^f = 0(&f "^) = o(l). 

After all, we conclude that bn^^^Ai^t = Op{k^). By symmetry, we also obtain 6^^^^A2,t = Op{k^). 
Next we consider A^^f By the use of associativity and linearity of integration, we have 



i,0,i' ,3' 



Moreover, we have 



p,q=0 
k„-l 



= E </?,"{/-'"^ii+'i^(4)i?(4)"} . B{4y 

p,q=0 



hence we obtain 



As,t^ E f ^^-''LtH{4)sD{i)^dB{i)^. 
. Jo 

Therefore, using Lemma 11.3(b), Lemma 11.4(b) and Lemma 11.5(b) instead of Lemma 11.3(a), Lemma 11.4(a) 
and Lemma 11.5(a) respectively, we can adopt an argument similar to the above one. After all, we conclude that 
bn^^^A^^t = Op{k^). By symmetry, we also obtain bn^^'^A^^t = Op{k^). □ 
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Proof of Proposition 4.4. By a localization procedure, we may assume that [SA3], [SA4], [SN] and [SC3] hold 
instead of [A3], (6.1), [N] and [C3] respectively. 

Lemma 11.6 implies that it is sufficient to prove that the condition [H] holds for Af",M'" <S {X, £^,3^^} and 
iV",iV'" G {r, but it immediately follows from [SA3], [SA4], [SN] and [SC3]. □ 



12 Proof of Theorem 4.1 and 4.2 

Before starting the proof, we strengthened the conditions [A5] and [A6] as follows: 

[SA5] We have [A5], and the processes , , A^ , A^ , (A^)', (A^)', {A^)' and (A^)' are bounded. Furthermore, 
there exist a positive constant C and A G (0,3/4) satisfying 

^^[l/t-/rAt|'|-^rAt] <C\t-T\^-^ (12.1) 

for every t > and any bounded F'^^^-stopping time r, for the density processes / = {A-'^)' , (A^)' , (A^)' and 

(A^y. 

[SA6] There exists a positive constant C such that 6„^iJ„(t) < C for every t. 

The following lemma can be shown by arguments analogous to those used in the proofs of Lemma 13.1 and 13.2 
in [24]. 

Lemma 12.1. Suppose that [A2] and [SA4] are satisfied. Let (M") be a sequence of square-integrable martingales 
such that there exists a positive constant Ci satisfying 

sup(Af")(J'')* <Cif„ (12.2) 

for any t G M+ and any n G N. Let G $ and let A be an F^^^ -adapted process with a bounded derivative such 
that there are a positive constant C2 and a constant A G (0,3/4) satisfying 

E [{A', - K^,f\Frr.t] < C2\t - r|i-^ (12.3) 

for any t G M+ and any bounded F^^^ -stopping time t. Let D" be a cddlag G^^^ -adapted process for each n and 
suppose that sup„ is a hounded process. Set A" = D" • A and define 

00 00 

for each t G M-|_ . Then 

(a) 6;;;^/'*supo<s<t = Op{kl) for every t. 

(b) h-'^^\mt\ = Opikl) for every t. 

(c) Suppose that [SC1]-[SC2] and [SA6] are fulfilled. Then 6„ "'^^'^ supo<5<( = Op{k'^) for every t if AT"- G 
{M^,€^,aH^}. 

Proof, (a) The process I is clearly a locally square-integrable martingale with the predictable quadratic variation 



Since 



we have 



fc„-i 



<?,<?' =0 



00 kn — 1 



E E PqPq'K'iiii'' Ai{iy^Ai{iyLjl+''ji+''\{A^^^^ 

00 q 

E E /3^,/3^,'i?l^i?-^■'AS(^)■LA'^(^)LJi.(A■/")i. 

i,«',9=l jj' = («-fc,> + l)Vl 



39 



Moreover, since \A'^{T)\\ < Ep=o^ and Kl^ < K]^ if s < < , we have 



fc„-i 



i,i',g=l j,j' = (g— fc„ + l)Vl p,p'=0 



and thus [SA4] and (12.2) yields 



fc„-i 



i,i',g=l j j'' = ((j-fe„ + l)Vl p=0 



Since X]i^=i -^t ^ have 



^fcn-t E E E i?+^(t)Hfc^t E Ei^^-^'wiE^^ 

i,g=l j = (g-fc„ + l)Vl p=0 p,g=0 4=1 J = l 



Since ^^^^^ \P"^^{t)\ < t and ^^^^ < fc„, we obtain {l)t < k^fl, and thus we have bn'''''{l)t = Op{kf^-brf^^^^) 

Op(fc^) because ^' > 9/10. The Lenglart inequality imphes that 6^^^^ supQ<;j,<j jl^l = Op{k'^) as desired, 
(b) We rewrite the target quantity as 

OO kji — l 

lit = ^ E Ai^(^)'-?^''^" 

i,j = l p=0 

E E / ^,:^^+''^"M^"(^)ids+ Y.T.< Kl^T^PD:M-iJ)i{A[,-AL}ds 



:IIi.t+Il2,t. 



First we claim that bn^'Hli^t ^ Op{kl) as n ^ oo. Since A'~.A'^.,KlUi+PD]}K'JIl+P'D'^ is J'^.v,, -measurable 



due to Lemma 11.2 and E[Mp {jy^M^ {jy^ l-^f jvj'] = if |j — j'| > A:„ — 1 due to the optional sampling theorem, 
we have 



E[lll 



fc„-i 



-EE E 

i,j'-\j-j'\<kr^ P,P'=0 



E 



^0 



A'^^A'f,Kyii-^PD:Ki=li+p'DiM-p{jyAq{jy: 



dsdu 



^E E E 



E 



^0 



On the other hand, the optional sampling theorem and (12.2) yield 



dsdtt. 



E 



rpj 



E 



{Mj,\jy)\T, 



rpj 



fe„-l 

^(/3;')2i?[(M")(J^"+«)t|j-, 

9=0 



rpj 



(12.4) 



fe„-i 



Since Kl^ Il'^f K^^^ lu^^ is J-"j;A(j j/j -measurable by Lemma 11.2, we obtain 

E[lll^] <k„fnE 
Therefore, [SA4] and (3.2) imply that 



E E E Krir'^-^imi'^'ip'+^'m 

i-i' h'j'-\j-j'\<k-a P:P'=0 



i,j p=0 



kn — loO OO 

EEi^'^'wiE^< 

p=0 i=l j = l 
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Since J2Zi < t and J^T^i ^"^t ^ ^n, we conclude that E[lllt] < k^fl, hence ^^^^^'^IIi,* = Op{kl). 



Next we estimate Il2,t. By Lemma 11.2 we have 

oo — 1 r pt 

Em2,t\] <Y.Y.^ K^ir-PE 

p=i LJo 

hence by the Schwarz inequahty and (12.4) we obtain 

oo kn — 1 



'\M^iJ)iiA',~AL)\\^: 



d.s 



E\ 



ii2.t| 



< 



Moreover, if P n we have |s - f ^'1 < |S^^+*=" - f J| V \S' ~f^\< (3'+''" - S') + {f^+^- - T'-i) < 2A:„r„(t) for 
any s E P. Hence by [SA4] and (12.3) we conclude that 



oo kn — 1 

E[\lh.t\] < (knTn)'-^ E E ^ 









< ikr,f„y-^E 


Jo 





kn — loO OO 

EEi^'^'wiE^*^' 

p—1 i—1 j — 1 



for some A S (0,3/4). Since J2Zi < * and J^T^i S kn, we conclude that E[\Ih,t\] < kl{k„fn)^-^/^ , 

hence bn^^^Ih,t = Op{klb';^'~'^^^'^^^~^^'^^~'^^^) = Op(fc2) because > 9/10 and A e (0,3/4). 

Consequently, we obtain bn^^'^Ht = Op{kn) as n — > oo for every t. 

(c) In light of (b), it is sufficient to show that (6^^^^fc~^II)„gN is C-tight. 

Fix a T > 0. Rewrite 11 as 

OO 

n* = 5]{M^"(^)iTi}.At, 

where Y.T=i Ep=o^ ot'^Kl^'Jl+P D"^ for each s e M+. Then for < s < t < T 

j=i J- 

1^ {b-'^'M^{J)iy |Ti| d^ I \pj' {A'J du I < k„{t - sf''Q,,{Tf'\ 
where 

oo „. 2 

Since T:^ is J^j^j -measurable due to Lemma 11.2, 

E[Q„{T)]^E 



oo „T 










(6,;i/^Af^'(^)i)Vf. 


Tidu 





oo 



J2 / fo-^/'(A/^(^)-').Tid^ 



p—0 i,j — l 



< E 



k„-l 



K^'^ E E i^T?i?+^(r)i(An(j 

P,'3=0 i,J = l 



If = Af"^ or A/" = 9Jt^, [SCI] yields 

A;,j, — 1 oo <^ri -L ^ 

^n'/'E E^^Tl?+"mi(A'n(j'^'+'')T<6-^/' E E ^TK'^"(r)||J^'+^(T)| 



p,q— 2, j — 1 p^q—O i,j — l 

kn — l/oO OO \ 

^^n' E Ei^'^'(^)i'+Ei'^-''^'(^)i' <4fc^&-^i^„(T), 

P,9=0 \ i=l j=l I 
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and thus by [SA6] we obtain -B[e„(T)] < k^. On the other hand, if = €^ , [SC2] yields 

k^ — l CXD kn^l OO 

p,q—0 — l p,q—0 i j — 1 

fcn — 1 CXD OO 

p—0 i—1 j — 1 

and thus again we obtain i?[8„(T)] < fc^. 
After all, for any > we have 



supP 



wib-'^^k-Hl;6,T) > 77] < supP [fc-i,5i/2e„(T)i/2 > ,,1 < t^-^S snpk-^E[er.{T) 



as (5 ^ if A/" e {M^, OT^}, and thus we complete the proof of (c). □ 
Lemma 12.2. Suppose that [A2]-[A5], [N] and [C3] hold. Then: 

(a) Suppose [A6] holds. bn^^'^{M" - M"} as n ^ 00, where 

^" = fc )2 E +L,,,(H^,Af^');^^^ 

(b) hTy^iMJ", N)t -^PQ as 00 for any N e {M^ , M^,M^,M^} and every t. 

Proof. By a localization procedure, we can assume that [SA3]-[SA6], [SN] and [SC3] instead of [A3]-[A6], [N] and 
[C3] respectively. Then, (a) immediately follows from Lemma 12.1. On the other hand, for TV € {M^ , ,M_^ ,K^} 
we have 

+ K'l . {Afj'(^)i . {m^,N)^,{iy}^ + . •{My,N)^^{jy]^ 

hence Lemma 12.1(b) yields (M",iV)t = Op(&y'') because (12.3) for A = (L, A/) (L,A/ = ^M^ ^M^) 
holds by [SA3] and the processes 3 and -J are G(")-adapted by [A2]. □ 

Proof of Theorem 4.1. Note that [Al'] implies [C3] due to Lemma 10.4, in all cases (a), (b) and (c), [A2]-[A6], [N] 
and [C3] hold; hence Lemma 12.2(a) allows us to consider M" instead of M". Moreover, [B2] holds by Proposition 
4.4, [CI] hold by [A3], and for the case (b) [Al](i)-(iii) and [W] with w given by (3.7) hold by Lemma 4.6(a)-(g), 
while for the case (c) [Al] and [W] with w given by (3.8) hold by Lemma 4.6. Therefore, we complete the proof 
due to Lemma 12.2(b) and Proposition 4.2. □ 

Proof of Theorem 4.2. Note that we do not need the condition [A6] in order to verify the condition [Bl] (see 
the proof of Lemma 12.1(b) and Lemma 12.2), an argument similar to the proof of Theorem 4.1 completes the 
proof. □ 

13 Proof of Theorem 5.1 

By a localization procedure, we may assume that [SC1]-[SC3], (6.1) and (6.4) hold. 
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According to Lemma 4.2, it is sufficient to prove M" 0. Therefore, it is sufficient to show that 



sup 

0<s<t 



Op{kJ, sup 

0<s<t 



Op{kl) 



(13.1) 



as n ^ for any {V,a) e {{M^ , g), , g'), {M'' , g'), (A^ , g), {^'^ , g')}, {W, p) € {(M^, 5), (2^, .9'), (2^'', .9'), 
audi >0. 

Consider the first equation of (f3.f). Let H, = Eij -^F^a(^)- • Wp{J)l. First we assume that (W, (3) e 
{{M^ , g), , g'), {dJl^ , g')}. By an argument similar to the proof of Lemma 4.3, we can rewrite Ms as Mg = 
K^- • {Va{iy_ • Wi3{J'y}s-, and thus H is a locahy square-integrable martingale. Therefore, it is sufficient 
to prove {M)t = Op{k^) as n — 00 for any t > due to the Lenglart inequality. Since \Wp{jy ,Wp{jy ]t = if 
|j - j'\> K, wc have 

[H], = K^yKi^'v^y-v^y- • [Wp{jy,w0y']s. 

i,j:i'.j'--\j-j'\<k„ 

Hence, (6.4), (6.9), (6.5), the Schwarz inequality and the fact that S for every j yield 

Eo mu < ki ■ knfni iog&„i [Wpijy,wp{jy']s, 

and thus [SCf]-[SC3], the Kunita-Watanabe inequality and the inequality of arithmetic and geometric means imply 
that i^o [pjs] < k^ ■ fc„f„|log&„| = o(fc^) because ^' > 1/2. Therefore, we obtain the desired result due to 
Proposition 4.50 in [29]. 

Next we assume that iW,f3) e {{A^,g), (21^, .9')}. Then, [SCI], (6.4), (6.5) and the Schwarz inequality yield 



Eo 



sup [H, 

P<s<t 



fc„-l 



9=0 



hence the fact that K^^ < fc„ for every j implies Eq [supq<^<( \^s\] ^ ^fc„r„| log 6„| • fc^j = o(fc^) because 
C > 1/2. 

Consequently, the first equation of (13.1) holds. By symmetry we also obtain the second equation of (13.1), and 
thus we complete the proof. □ 
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